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ABSTRACT 


Models are developed to study the readiness and 
subsequent combat performance of an air-interceptor squadron 
facing sudden attack. These models necessarily link combat 
with logistics. The models are mainly analytical and not a 
Monte Carlo simulation, and can be used to indicate the 
optimal weapon system to be procured and to study the effect 
of peacetime decisions on combat outcomes. The logistics 
models use the matrix-geometric approach to study the 
general multivariate repairman problem, with the possibility 
of simultaneous component failures. A repairman assignment 
problem is formulated and solved using a multivariate 
continuous-time Markov decision process. Surprise scenarios 
are analyzed and represented explicitly. Air-to-air combat 
is modelled as a transient multivariate continuous-time 
discrete~-state Markov process. Diffusion theory is used to 
approximate the solutions. The reason for using diffusions 
is ease of interpretation and computational economy. A 
comparison with simulation results shows that diffusion 
yields good approximations. Improvement to the diffusion 
approximation is provided by applying "large deviations" 
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I. INTRODUCTION 


A. GENERAL 

Defense decision makers face a difficult planning and 
management task: assuring that their peacetime decisions 
result in maximum effectiveness of their combat units ina 
wartime environment. It is apparent that the defense deci- 
sions made today have great impact on a nation's security in 
the future. 

Since the end of World War II, the primary emphasis of 
logistics modelling has been to minimize cost under peace- 
time conditions. This 1S a consequence of a long period of 
relatively universal peacetime conditions; the enormous cost 
of modern sophisticated weapon systems; the long lead times, 
from the procurement to actual deployment, of these systems; 
and the general reduction in defense budgets over the years 
(with the exception of the most recent historical period). 
As a result, the logistics component of military resource 
requirements is becoming increasingly costly, with control 
loosely related to operational performance. Furthermore, it 
is highly vulnerable eS military budget cutting (Drezner and 
Hillestad, 1982). 

Defense decisions must be objectively oriented. Unin- 
structed and unaided intuition alone is insufficient. 


Models must be a part of the decision-making process. 


RG, 


Drezner and Hillestad (1982) point out that, as a result of 
economic emphasis, and lack of distinct relationships to the 
operational performance, models are constructed around 
peacetime efficiency, by considering systems and policies 
that are based on least-cost peacetime alternatives. Rich, 
Stanley and Anderson (1984) point out that logistics 
planning must now more directly and explicitly consider 
wartime threats and activities. In their words: 

The weapon system development community should develop 
analytical approaches and tools to evaluate trade-offs in 
operating concepts founded on alternative basing and sup- 
port arrangements. Moreover, a weapon system's support 
characteristics should receive increased emphasis and 
clearer articulation in the formal expression of system 
requirements in the design and development stage. That 
emphasis must be matched by a more concerted use of logis- 
tics capability assessment models during concept formula- 
tion and advanced development and by earlier testing and 
evaluation aimed at uncovering the correcting weapon sys- 
tem support characteristics that could limit the system's 
combat effectiveness. 

We endorse the above views, and believe that the models 
constructed and analyzed in this thesis provide a step in 
the indicated direction. 

The main objective of this thesis is to develop analyti- 
cal models that will] assist in making decisions regarding 
the design or procurement and operation of a defensive 
weapon systen. 

This thesis analyzes an air defense weapon system, in 


particular an air-interceptor squadron, and constructs 


combat-logistics models for its performance. In general 


Jee 


these models or their extensions can be applied to other 


types of weapon systems and warfare scenarios. 


B. BACKGROUND 

We start by describing the characteristics of the real 
problem facing the defender, sketching the main features we 
choose to model, and stating the decision problems we 
address in this thesis. 

The real problem as faced by the defender consists of 
the following components: 


(a) Threat: There exists the possibility that the enemy 
will carry out a hostile air attack against a small 
country (or region) with a single defending air base. 


(ob) Air Defense System: In order to defend the country 
from a hostile air attack, the defender needs to de- 
Sign (or procure) and operate an air defense system. 
The air defense system is to consist of an air- 
interceptor squadron, short-medium range surface-to- 
air missiles (SAM), an early warning system, communi- 
cation command and control (C?) system, and an 
intelligence system. 


(c) Early Warning System: The early warning system con- 
Sists of a long-range ground-based radar with identi- 


fication friendly or foe (EFF) Capability, waene 
system perhaovs uses information obtained from an air- 
borne warning and control system (AWACS) operated by 
friendly forces. 


(d) Intelligence System: Intelligence information can be 
provided by monitoring enemy movements and deploy- 
ments, monitoring enemy military training activities 
and their military communications. Analysis of the 
information obtained provides expectations about 
enemy intentions. 


(e) Logistics Systems: The logistics system consists of 
repair shops and a supply depot. Each repair shop is 
specialized in repairing a certain type of module, 
e.g., engine, radar, airframe, etc. Each shop is 
assigned a certain number of "repairmen." We use the 
term "repairmen" to stand for repair units; the 
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iMmitatitonoeenm the Units’ capacity for work may 
actually be instrumentation, tools, or the availa- 
bility of spare parts. The supply depot is provided 
on base. 

The air interceptor squadron is assigned peacetime mis- 
sions, such as training and reconnaissance. The equipment 
on the interceptor is susceptible to failure during such 
(essential) operations. Thus some of the air-craft assigned 
to the squadron may not be available at a given moment. 

The logistics system is responsible for maintaining 
maximum aircraft readiness; the aircrew, the c?, and the 
early warning eyecare assist in causing maximum destruction 
to enemy bombers. Clearly, there 1s a need for models that 
are capable of answering questions concerning the 
effectiveness of new weapon systems in combat, and of 
analyzing the tradeoffs between the various components of 
the weapon system. The combat-logistics models presented 
here contribute to fulfilling this need. 

This research constructs and analyzes some combat- 
logistics models for the air-interceptor squadrons. The 
combat-logistics models integrate logistics models with 
combat models. 

The objectives of combat-logistics modelling are: 

(1) to determine the optimal weapon system: given a 
specific threat, what is the optimal weapon system 
to be procured in order to optimize a certain 
measure of effectiveness (MOE) in combat? This 


question is to be answered with consideration paid 
to budget, manpower and storage space limitations. 


is 


(ii) to provide an approach for evaluating the effects of 
changes in the logistics system (in non-combat 
periods) on the effectiveness of the weapon system 
(in combat periods). 

C. APPROACH 
The approach chosen for developing the combat-logistics 


model is: 


1. To analyze the aircraft squadron logistics system and 
construct analytical models to represent it. 


2. To model and analyze the effect of considering differ- 
ent surprise scenarios. 


3. To develop analytical air-to-air combat models that 
can represent the type of combat the squadron is ex- 
pected to undergo in case of enemy attack. 

4. To integrate the models constructed in (1) and (2) 
with the combat models constructed in (3) above, and 
use mathematical programming techniques to optimize 
the effectiveness of the squadron subject to antici- 
pated "real life" conditions and cost constraints. 

D. LITERATURE REVIEW 

Our interest is mainly in the analytical side of the 
general problem outlined, and we review some of the work 
that has been done on related problems. 

Multi-echelon inventory problems have recently received 
considerable attention by logistics analysts. This is 
because the multi-echelon problem captures many logistics 
factors such as: the effect of component shortages on 
weapon system avallability, the stockage levels at the 
supply depot, repair capability, the existence of appropri- 


ate and reliable test equipment, manpower, and transporta- 


tion. Zangwill (1966) developed a deterministic model to 
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determine the optimal production schedule for a multi- 
product, multi-facility production and inventory problem. 
Sherbrooke (1968) took a major step in analyzing multi- 
echelon supply systems by developing the Multi-Echelon 
Technique for Recoverable Items Control (METRIC), which is 
an analytical model of a base-depot supply system. The 
METRIC model assumes that the item demand is a stationary 
compound Poisson process with a mean value estimated by a 
Bayesian procedure. A failed item is repaired on base with 
probability eg, or sent for depot repair with probability 1- 
8. If an item is sent for depot repair, the base gener- 
ates a resupply request on the depot. The model assumes no 
lateral resupply between bases. The model minimizes the 
expected backorders for any system investment, and computes 
the optimal redistribution of stock. 

Muckstadt (1973) extended the results of METRIC to 
incorporate a multi-indenture (subcomponents of components) 
relationship. Mod-METRIC computes both base and depot spare 
stock levels for all items and all indenture levels. 

A further extension of METRIC, which considers non- 
stationary demand processes, is the Dyna-METRIC model, see 
Hillestad (1982). For a description of Dyna-METRIC froma 
logistician's perspective, the reader is referred to Pyles 
(1984). The Dyna-METRIC model assesses the contribution of 
the components' support processes to wartime aircraft 


availability and sortie rate. 
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Drezner and Hillestad (1982) point out that a major 
weakness of work in the logistics area for military applica- 
tions is the lack of consideration of the weapon system 
availability and capability. The use of backorder measures 
for determining stockage levels does not consider the 
importance of the various components of the weapon systems. 
Backorder measures are common in the METRIC family of 
models. 

We now mention several features of the maintenance 
activity that can be incorporated into our logistics models. 

One widely used method of increasing operational availa- 
bility is to cannibalize weapon systems, substituting good 
components from one downed aircraft to prevent another air- 
craft from becoming unavailable. However, this area has 
received little attention in the literature, although the 
Situation of full instantaneous cannibalization was 
considered (see Fisher and Brennan (1986)). A pioneer work 
for modelling cannibalization is by Hirsch, Meisner and Boll 
(1968). The most recent work in this area is by Fisher and 
Brennan (1986), where several cannibalization policies are 
compared uSing simulation. Our study includes consideration 
of cannibalization strategies. 

Logistics models are evolving toward the wartime support 
aspects of logistics but more relevant measures of military 
performance must be considered. Rich (1986) points out that 


we cannot be satisfied with such measures as aircraft 
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availability and sortie generation capability. Instead, we 
need to focus on measures of system output such as targets 
killed. The observation has helped motivate the research 
reported in this thesis. 

A problem that currently faces defense decision makers 
is the extensive specialization, and the resulting size, of 
the maintenance force. An F-16 wing, for example, includes 
1089 support personnel organized into 23 different special- 
ties; see Rich, Stanley and Anderson (1984). This situation 
leads to vulnerability of the forces being supported and 
stresses manpower resources. An alternative that decision 
makers usually consider is cross training of the maintenance 
personnel so that they become generalists, i.e., capable of 
repairing more than one type of system (e.g., propulsion 
system, hydraulic system, fuel system, etc.). This alterna- 
tive becomes more attractive as the technology evolves, and 
systems are designed to be more modular. Increasingly, 
repairs at the base level consist of fault detection and 
replacement of the faulty modules. The faulty modules are 
then sent to the depot for actual repair. 

Rich, Stanley and Anderson (1984) also point out that 
combat forces must be able to operate in forward areas with 
minimal support resources. This means streamlining the 
flightline workforce by training and using maintenance 


generalists. 


by, 


If the above alternative is employed, then one of the 
major questions that will face the decision makers is: how 
to manage the maintenance force so that the air-interceptor 
squadron readiness is sustained at the maximum possible 
level? Chapter III of this thesis addresses this question 
by searching for an optimal repairmen assignment policy that 
maximizes the expected number of aircraft ready to engage in 
combat. We do this by formulating the problem as a 
multivariate-continuous-time Markovian decision process. 

Recently, Szarkowicz and Knowles (1985) considered the 
problem of determining optimal operating policies for an 
M/M/S queueing system. The system state is represented by a 
bivariate vector, the first component is the number of 
customers in the system, and the second component is the 
number of active servers. They used a commineoue time 
Markov decision process formulation to obtain an optimal 
control policy for the number of active servers; the cost 
structure includes customer holding and server operating 
costs as well as a linear switching cost. 

The problem that Sparkowicz and Knowles analyzed differs 
from our problem, since we consider more than one type of 
item to be repaired, and we need to have an item of each 
type to be operational in order to have an operational 


alrcraft. 
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For more work related to this area, the reader is 
mererread to Howard (1969), Zuckerman (1986), Jo (1984), 
Geol! (1972) and Miller (1968a), (1968b) and (1969). 

To consider the effect of the logistics system and the 
allocation of fixed monetary resources to competing but 
interrelated demands (such as, spares, test equipment, 
personnel, etc.) on the combat outcome of the weapon system, 
we need to consider the combat process explicitly in the 
model. 

In order to keep the model analytically attractive, we 
chose to represent the logistics system at a lower level of 
detail than the METRIC family of models, and to introduce 
the combat model explicitly. The logistics model is there- 
fore relatively simple. It presents only the most dominant 
features of a combat-logistics process (i.e., the process 
that the weapon system undergoes in peace and wartime 
environments). This research effort may be regarded as a 
prototype of a large family of more complete combat- 
logistics models. Taylor (1980) points out that a simple 
model may yield an understanding of important relations that 
are difficult to perceive in a more complex model, and such 
insights provide valuable guidance for higher-resolution 
computerized investigations. 

Since the combat model plays a role of the same 
importance as the logistics model, an entire chapter of this 


thesis is devoted to the combat model. In particular, our 


IES) 


approach is to provide efficient computational methods to 
obtain "exact" solutions to multivariate Markov models, 
supplementing these with approximate, easily comprehended 
approximations based on diffusions. 

Recently, Taylor (1983) presented a comprehensive 
treatise on Lanchester-type models for combat, l.e., 
differential-equation models of attrition in force-on-force 
combat operations in which both deterministic and stochastic 
models for combat are considered. Taylor (1983) states, 


"Combat is anything but a deterministic process." Thus, in 





order to incorporate the random nature of combat into the 
model, the combat process must be represented by a stochas- 
tic process. Combat analysts tend to represent the combat 
process probabilistically by Markov processes; see for 
example, Taylor (1983), Kimble (1970), Clark (1969), and 
Bhat (1984). 

The most recent work done in this area is by Karmeshu 
and Taiswal (1986), where they incorporate the effects of 
environmental fluctuations by regarding the parameters of 
the problem as stochastic processes. 

Feigin, Pinkas, and Shinar (1984) proposed a simple 
Markov model for the analysis of many-on-many air combat. 
The model is a four variate-Markov process where the state 
variables are: the number of free blue planes, the number 
of free red planes, the number of pursuing blue planes, and 


the number of pursuing red planes. Their solution approach 
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was to construct and solve the forward Chapman-Kolmogorov 
equations. 

We choose to model the air-to-air combat process by 
generalizing the deterministic model so that some 
probability statements can be evaluated. This can be done 
by representing the combat process by a multivariate diffu- 
sion process. We find that the diffusion-combat models 
constructed in this thesis provide good approximations to 
the corresponding Markovian-combat model. For the 
definition, description and discussion of diffusion 
processes the reader is referred to Karlin and Taylor 
(1981). For related work the reader should refer to the 
papers of Iglehart (1965), McNeil (1973), Schach and McNeil 
meee, Gaver and Lehoczky (1975), (1977a), (1977b), 


mov 7cC), (1979), and Gaver and Jacobs (1985). 


E. ORGANIZATION OF THE THESIS 

This thesis models a problem that is complex and has 
many factors to be considered. Therefore, we choose to 
decompose the problem into components: a logistics problem, 
and a combat problem; we then analyze each one separately, 
build an analytical model for each, then integrate (or link) 
the various models to evaluate the system effectiveness, 
which is, in combat terms, some measure of "leakage" or 
Survivorship of the attackers. Each chapter analyzes and 
develops a model for a specific subproblem. Chapter II 


models the general repair system. Chapter III studies and 
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models the repairman assignment problem, while Chapter IV 
studies and models the air-to-air combat problem. Chapter V 
provides the approach for linking the logistics model to the 
combat model. Figure (1.1) illustrates the general 
structure of the thesis. 

In the first part of Chapter II, we build a model of a 
simple logistics system. We assume that each aircraft re- 
quires a single module in order to be considered opera- 
tional. The problem is modelled as a birth-and-death 
process, and also as a closed migration process. A closed 
form solution for the limiting distribution is presented. 
This is a simplified version of the real problem; it serves 
as a starting point or feasibility study. 

The surprise phenomenon is then analyzed and classified 
as total or partial surprise. Depending on what tvpe on 
surprise is considered, the squadron readiness probability 
distribution is then computed. A simple example is provided 
to illustrate the model. 

In the second part of Chapter II, we generalize the 
above model to represent a two-module logistics system; 
i.e., it is assumed that each aircraft requires two opera- 
tional modules (one of each type) in order for it to be 
considered operational. We find that a simultaneous failure 
mechanism must be introduced in order to have a realistic 
representation. A simultaneous failure mechanism means that 


the conditional probability of an aircraft failure due to 
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both modules failing is positive. The problem is formulated 
as a bivariate birth-and-death process. To simplify the 
computations the problem is then formulated so that it can 
be presented in a matrix-geometric form. This is done by 
adopting the arguments in Gani and Purdue (1984) and in 
Gaver, Jacobs and Latouche (1984). For an explanation of 
the matrix-geometric formulation the reader is referred to 
Neuts (1981). The squadron readiness probability distribu- 
tion for the two-module logistics system is then presented 
for both types of surprise. This is followed by a simple 
example to illustrate the technique. 

In Chapter III, we hypothesize an operational logistics 
scenario. The problem is a repairmen allocation problen, 
where the repairmen are assumed to be general technicians 
capable of repairing both types of modules. The mainte- 
nance supervisor is interested in finding the optimal repair 
policy that maximizes the squadron readiness. The problem 
is formulated as a bivariate-continuous-time-Markov-decision 
process. A one-to-one transformation of a multivariate- 
Markov process to a univariate-Markov process is presented. 
The transformation allows us to use the existing theory and 
techniques for the univariate-Markov decision process to 
solve a multivariate one. The problem is then solved by 
dynamic programming and linear programming approaches. An 


example to illustrate both approaches is given, followed by 
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a comparison and evaluation of the results of both 
approaches. 

In Chapter IV we discuss the characteristics of the air- 
to-air combat and provide the following air-to-air combat 


scenarios to be modelled: 


(1) BCD Scenario: Both defenders and enemy bombers are 
assumed to be vulnerable, and defenders spend some 
time searching for a free enemy bomber. Once a free 


enemy bomber is detected, it is then engaged by a 
free defender. The one-to-one engagement is assumed 
to continue until either a bomber or a defender is 
killed. If the bomber is killed the defender once 
again searches for a free bomber; the process 
continues. 

(11) I Scenario: This scenario assumes that the 
defenders are invulnerable. Only one free defender 
can engage a free bomber, and the engagement is 
assumed to be instantaneous; i.e., once a defender 
becomes free, no time is spent searching for a free 
bomber if one is available (perfect C? system). 

This is the simplest situation; it is characterized 
by a one-dimensional Markov chain. 

Both of the above scenarios implicitly assume that the 
enemy bombers arrive in combat simultaneously. 

In the second part of Chapter IV, we construct and 
analyze deterministic models for the above two scenarios. 
Next we generalize the deterministic models by developing 
diffusion models to represent the air-to-air combat. Simple 
continuous-time discrete-state Markov models are then 
constructed to represent the combat processes for the above 
scenarios; the latter models are referred to as Markovian- 
Combat models (of course the diffusions are an approximation 


to these, and are themselves Markovian; the reason for using 


diffusions is ease of interpretation and computational 
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simplicity). The forward Chapman-Kolmogorov equations for 
these models are derived, as are their Laplace transforms. 
Techniques for solving the Laplace transforms are presented. 

In order to evaluate and compare the different 
approaches, the Markovian combat process for the BCD 
scenario is simulated. A large deviations equation for the 
MOE, under the I scenario, is derived; for the large 
deviations approach see Feller (1971), and for applications 
see Mazumdar and Gaver (1984). 

Finally we present in Chapter IV some illustrations to 
compare and analyze the combat models. 

In Chapter V we study the entire combat-logistics 
Situation that confronts the decision maker. We then 
present the model's basic concept and assumptions. The 
problem is then formulated as a non-linear-integer mathe- 
matical programming model. 

We first examine the single-module combat logistics 
(1MCL) model which is a result of linking the single-module 
logistics model to a combat model, subject to budget and 
operational constraints. The two-module combat logistics 
(2MCL) model is next constructed as a generalization for 
IMG Io. 

By way of illustration we present some examples for 1MCL 
and 2MCL models using both the BCD and the I scenarios. 
Some sensitivity analysis on the combat and logistics 


parameters are also conducted. 
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We close our discussion in Chapter VI with a review of 
the results obtained and their implications, and some 
concluding remarks and recommendations for further research. 

Two appendices are included to describe additional but 
somewhat peripheral research related to the main emphasis of 
the thesis. 

Appendix A contains a discussion of the large deviations 
technique. A large deviations equation for fixed, and 
randomized, sums of independent and identically distributed 
random variables is presented, followed by applications to 
compound Poisson process and renewal processes. The 
techniques have application to classical inventory control 
problems. A proposed approach to minimize the large devia- 
tions error is introduced, followed by an illustration of 
the approach applied to the compound Poisson process. 

In Appendix B, we generalize Lanchester's linear law by 
developing a diffusion model. A simple continuous-time 
discrete-state Markov model is then constructed to represent 


the corresponding combat process. 
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Ii. OPERATIONAL EOGisiics MebErS 


A. INTRODUCTION 

This chapter formulates and analyzes some operational 
logistics problems. Logistics is an area that gives rise to 
classical operational research problems which suggests that a 
considerable body of work has been done in this area. Never- 
theless, the linkage between combat models and logistics is 
a research area that is ripe for further research. Particular 
attention in this thesis has been directed towards the repair- 
man problem. Feller (1971) defines the repairman problem, and 
Kelley (1979) provides a closed product-form solution for the 
Single type module repairman problem. This chapter formulates 


and solves a multivariate repairman problem with simultaneous 


failure and consequent simultaneous demand for several resources. 


Gaver and Lehoscky (1976) formulated and analyzed a 2-module 
repairman problem, wherein there was a number, a, of aircraft, 
each requiring both types of modules, one of each, to Operate. 
When an aircraft fails it has conditional probabilities Py? Po 
and P15 of being down due to a failure of Type 1, Type 2, or 
both types of modules, respectively, where P) + Py + Pyo = flee 
This model assumed that an aircraft will be in repair until 
the failed modules were repaired (i.e., the assumption indi- 
cates that there were no spare modules assigned to the organi- 


zation). The problem was modelled as a diffusion process which 
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- The total number of Type 1 and Type 2 modules available 
in the squadron are 2 and 3, respectively (i.e., 


Ma =) 2 


- The maintenance commander is assigned 3 repairmen, 
and every repairman is capable of repairing both 


modules. 

- An aircraft is reported down with a rate \} = 1 aircraft 
per day. 

- The probabilities of an aircraft down due to module 
failures of Type 1, Type 2 or both Types are Py = .4, 
Py = or Pio = .l respectively. 


- Modules of Type l and Type 2 are repaired with rates 
HW, = ~o ame Uy = 1 modules per day. 


A FORTRAN program has been written to compute the infini- 
tesimal generator matrices, and create the output format 
suitable for optimality analysis. The linear programming 
was implemented using the LINDO interactive package. A 
FORTRAN program to implement the dynamic programming approach 
was written using the policy improvement technique. Appendix C 
presents the computer listings for the programs. 


The graph of the above system is shown in Figure (3.5) 


where the repair rates are functions of the decision. The 
infinitesimal generators oho) y = 0,1,2,3 are illustragee 
in Figures (3.6), (3.7), (3.8) and (3.9) respectively > ie 


infinitesimal generators Q for any policy can now be Calleug, 
lated using the infinitesimal generators 7 vy = 0,1,2y2 
This is done by picking the necessary rows from the four QO 


matrices. For example, suppose the infinitesimal generator 


for the polacy 


r = (lb 2-2-0538 2°10 20222 eee oe 
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(M, +1) (M,+1) 


qn) ser tn) + ) g(n,m)V_ (119 ) 
m= 


The set of equations (3.19) consists of (M, +1) (M,+1) equations 
mach (M, +1) (M,+1) +1 unknowns ((M, +1) (M4t1)V_'s aie. CG). 


Therefore set V QO and solve for the rest. 


(M, +1) (M,+1) 
Thus, for a given policy we can find the gain and the 
relative values of that policy by solving the (M, +1) (M,+1) 


linear equations simultaneously with Y (M41) (M541) =). 


The Policy-Improvement routine is then used to find a 


Policy that has higher gain than the original policy. 


(M, +1) (M,+1) 


ian fe (i) L q, (nm) Vv, 


The optimal y will be the decision to be taken when in 
state n; hence, a new policy has been developed. The proce- 
dure is then repeated until g is maximized, i.e., when the 


policies on 2 successive iterations are identical. 


J. MODEL ILLUSTRATION 
The following basic data were used as an example: 
- An aircraft requires 2 types of modules (e.g., engines 
mmcdreOnnunicatlons) to be Operational. Modules of Type 
1 are engines and modules of Type 2 are communications 


equipment. 


Site siuadron 1S assigned exactly 2 aircraft. 
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The set of equations (3.16) is a matrix representation 
of equations (3.15). The equations are a set of linear, 
constant-coefficient differential equations that relate the 


total reward in time t from a start in state n t0 Ehe @uame 


ties f(n) and q(n,m). But tor large =] )(hewardy eco. 
VEE) eee ce ae Ni . n = 1,...,(M,+1) (M,+1) 
Thereterte: 
: dv (t) 
Jn dt 


Using equation (3715) we obtain: 


(Mj +1) (M,+1) 
oe ea: ) q(n,m) (tg +V,) 
m=] 
(M,) +1) (M,+1) (M) +1) (M,+1) 
2 a f(n) +t ) g(n,m)g,, + , g(n,m)V_, 
m=1 m=1 
(sb 
For equation (3.17) to hold for all large &€,;, we must Waves 
(M, +1) (M,+1) 
) q(n,m)g_ = 0 (3.18) 


=] 


and 


ee, 


V_, (ttdt) = (l+q(n,n)dt) [f(n)dtt+v_ (t) |] 


ae Gorm dey (2) + o(dt) 
n7m 


Suoeracting V_, ft) from both sides and dividing by dt, the 


above equation becomes: 


V_, fttdt) -V_ (t) 


ar =e Cnyeet Gunmen) £(n)adt + q(n,n)V_ (t) 


ve) eile (ie) 
n#m 


Mereate > 0; the above equation becomes: 


(M, +1) (M,+1) 


ze n't) = £m) + a q(n,m)V_ (t) (3.15) 


n = 1,..., (M,+1) (M,+1) 


Changing to vector notation, this becomes: 


d aS 7 = as 
Ben ee Orn Ge) (3.16) 
where: 
V(t) = [v,(t) (t) ] 
= Pael ee 

>T 
F = [£(1),...,£(M,) +1) (M,4+1)] 
Spee ae tn beesimal sqenerator . 


Pes 


READ: f£(n) (No. aircraft ready when 
HPI ge} 


Cyan Ii) (infinitesimal rates) 


For each state n determine a decision 
d, that maximizes f(n) 










Set all relative values Ve 


POLICY IMPROVEMENT: For each state n find the 
decision y*(n) that maximizes: 
(M, +1) (M,+1) 


f(n) + a Si, Welpaly ee 


Using the relative values Ve of the previous policy 












q(n,m) = ay 


V = 0 
(M, +1) (M,+1) 


SR an a ec Se NN Se 6 a PT TT 


| VALUE DETERMINATION: Solve for all remaining 
(Mj+1) (Mg+1)-1 relative values V, and the gain 
of the system (g) by solving: 


(M, +1) (M,+1) 


g = £(n) + ) q(n,m)V_ 


If the policies on 2 successive 
1lberations are identical scope. 


Figure 3.4. Iteration Cycle Schematic (Howard, 1367) 












Alia 


The optimal policy can be found using the policy-iteration 
method which consists of the value-determination operation and 
the policy-improvement operation. Both operations can be 
used recursively as shown in Figure (3.4), until the optimal 
molrecy is found. 


Let: 


V_, ¢t) = Total expected reward the system will 
earn in a time t if it starts in state 
ais 


V, (ttdt) can be related to V, ft) by considering the 


following transitions and rewards. 





iC Eanshe reward probability 
n n £(n)dtt+v_ (t) 1 - S SU ere 
n#m 
(m#n) V_, ft) Sho pin) elee! Vm4n 

Therefore, 
Meeterdt) = (1 - } gqi{n,m)dt) [£(n)dt +v_(t)] 

n n 

n4#m 


+ } q({n,m)dtv,(t) + o (dt) 
n#m 


BUT , 
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q(n,m) = Yate Of EransSielon  rrenmstace ene ae 
state m. 
r(n,m) = reward associated with the transition 


cron Nn tome 


Since there is no reward gained by transitioning jeaem 
state n to state m, r(n,m) = 0 £or n # m, and A(n) =) mie 


Hence, for the repair scheduling problem: 


(M, +1) (M,+1) 


g = ) «_£(n) (3.14) 
geal 


where: 


f(n) = minta,M.- il +1)+1} 


1 oe 
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Macrae 


D L 








. eae 
»Mo-n +] reer -l 





Since at each state a decision has to be chosen from a 
number of decisions, therefore it can be thought of as having 
several Markov processes, and the objective is to know which 
one yields the highest expected number of aircraft operational, 
in the slong eur. 

It is possible to describe the policy by a decision vector 
whose elements represent the number of the decision selected 
in each state; i1.e., the gia element of the vector IT indicates 
the number of repairmen to be assigned to Shop 1 whenever 
the process is in state i. 

An optimal policy is defined to be the policy that maxi- 


mizes the gain, or average return per transition. 


Lays) 





Mitteenwot COnStraints = 3112 constraints. 


Therefore the 'practical' problems tend to be large 


under this formulation. 


I. DYNAMIC PROGRAMMING APPROACH 

The finite-state-continuous-time-Markov process being 
analyzed has been shown to have a limiting distribution. 
Therefore, the policy-iteration method for the solution of 
the sequential decision process, developed by R. Howard 
(Howard, 1969), can be used. 

Howard states that every completely ergodic Markov process 


with rewards will have a gain, g, given by: 


N 
> : (2 1 
n=1 
where: 
N = number of states 
i = irc ing probability of beinggin state n 
h(n) = expected immediate return in state n defined 
lane 
many = ie (Cato 2) te) (Gaunt oa opin, (37,13) 
mAn 
i = IL, ee ,N 
where: 
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yY. This observation (Ross, 1983), allows useto solves] 
linear program, and the solution will always have y as either 
Oe 

The above formulated linear programming problem has 
(Mol ae = MM, + M, + M. + 2 functional constradiimeas 


Since the infinitesimal generator Q is of rank M,M,+M,+M,+1, 
there is a constraint that is linearly dependent on the other 
constraints. Hence the problem has a single redundant con- 
straint, and the number of constraints in the L-P can be 
reduced at no loss by dropping one of the constraints (11) 

in the L-P. 

The L-P can be solved by the simplex method, and @eemsala= 
tion has some interesting properties (Ross, 1983). The solution 
va ie a contain (M) +1) (M,+1) = M,M,+M)+M,+1 basic variables 
at) > 0. Since the repair policy was acssimmcasrome. seas 
tionary, the policy is deterministic, meaning that one and 
only one decision will be chosen each time the process enters 
any given state. It follows thatyonl, gence Tm hy*) > 0, while 


the ia) = 0 for y= 0;152.2-7) 07 ve Since the Markov 


process is irreducible and Since every state is positive 


recurrent, it follows that = Nea) > 10 $C inane — 1,2,..., (M,+1) (M41 
Therefore, kee) > 0 for exactly one y = 0,1,...,R, £OEMeaem 
n= 1,2,...,(M,+1) (Mj+1). 


The L-P has (R+1) (M, +1) (M,+1) decision variables. Suppose 
that the problem at hand has My = 50, M4 = 60, R= 20. Them 


Number of decision variables = (21) (51) (61) — 965,33.) Vag. 30a 


IE: 


ice 0, 1,..-,R, n = eee eel) (Mor), that 
maximizes the objective function and satisfies the constraints 


memene solution for the following linear programming model: 


LP 
(M) +1) (M,+1) R 
max ) ) £(n)7,(y) 
TI n=l y=0 
Suogject to: 
(M) +1) (M,+1) R 
el) } Lo tS 
n=l y=0 
<a ei : 
(cist) Tt. (y)q (n,m) = OQ 
n=1 y=0 2 u 
m = 1,2,..., (M, +1) (M,+1) 
Gem) mtv) > 0 yea GO 2, raze 


n= 1,2,...,(M,+1) (M,+1) 


pnceweme Objective function is a linear function of the 
decision variable 1m, (y); and the CensceralncS form a Set Of 
linear equations, the above problem is a linear programming 
problem. Note that, even though f(n) (f(n) = minta,M,-i,M,-j}) 
memo vonlinear function of i and j, it is not a function of 
T fy) - 

The value of oe, will ©dtetate the value of y, where 


ef i (Y) > 0 then the decision to be taken when in state n is 
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where: Gin, M}ees ele tn ayy element of the matrix Q, the 
infinitesimal generator of the Markov Process; i.e., q(n,m) 
is thought of as the rate from state n to state m. Therefore 


TY) must satisfy the following linear relations: 


(M, +1) (M,+1) R 
it ) Perea a= vl 
n=l y=0 
(M, +1) (M,+1) R 
2 . ) mi(a,(nym) = 0 m= 1,2,...,(M)+1) (My 
db y=0 
and 
ce Ta > 0 eH Oy eZ eee in = 1,0,2,...,(M,+1) (M,+1) 
The long run expected number of aircraft that are opera- 
tional is given by: 
(M) +1) (M,+1) 
E{Number of aircraft operational] = > f(n)T, 
n=1 
(M) +1) (M,+1) R 
= ) ) £(n)7_ Og 
n=l y=0 


Therefore the objective function is given by: 


(M, +1) (M +1) R 
) Sea) ae 


2 
maximize » 
n=l v 


ed 


Therefore, 
i) — Te ay) (a, IL) 


where: 
faye = Pistdte.— Nneand decision = y} 


These limiting probabilities were obtained from equations 
eo) and (3.8). 


From the law of total probability, we get: 


P{state = (i,j)} = } P{state = (i,j) and decision = y} 
Bf 
nes ? ea) (Seale) 


Since T toed Limetang Gistribution, then lies is the 


unigue solution for the following system of linear equations: 


(Mj +1) (M,+1) 

il ) T = lL 
n=l] = 

(Mj +1) (M,+1) 

Di a3 T 44 (n,m) ao eee Mtl) (MA +1) 
7 (the forward equations) 
and 

eer > (OO @ Sy Ayo o0 o (Taal 


13:0 


state for (Y (t)icumce 


n- (M.+2) 


2 state for {xX (t), 


X5(t),t > O} 


(ial 7g=)) 






= 
=~ = 
am os 
+ - 
. oy tos 
Pi2*n-(M,+2) 7 e 
= a 
“< —— 
an S 
Ps Ton 
= 
PoMn=1 Poa. 
et 2 n : (n+l) 
oa } (2,5) Cor sk, 
min{R-y(n),j}u, min{R-y (n+l), 
i jtl}us 
el 
ea 
= 
Di ae cen 
= = a Ne | 
a, =o 
= 
4 
= 
n+ (Mo+1) n+ (M,+2) 
(i+1,3) (i+l je 





Figure 3.3. The Transitions Flow for State Sct 
; for any Fevair Policy 
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Peieure 3.2. 


u 
a (M, +1) (M+1) 


East c POP LOwetOr che 
Failure-Repair Process 


Lens 





v 
i (M, +1) (M,+1) 


(M) +1) (Mot. ) 


(M, »M,) 


u be the total repair rate when the process is 
Liss 
in state mn fom Shee: 


Ho be the total repair rate when the process is 
gia 
in. state mM fOr Siepe. 





Therefore: 
Ne ee een) 
Hin = Hy min(y (n),1) 
Mon = Ho min (R-y(n),j) 
where: 
Eth) o= min{fa,M,-i,M,-3} 


1 and j are given by equations (3.6) and | (Jae7@ 


Figure (3.2) shows the corresponding transition graph 
for the process {Y(t),t > 0}. The transition for any sieaee 


(1,3) 1S shown in Figure (3.3) €or any Pepaduerotre 2 


i's he LINEAR PROGRAMMING APPROACH 
Let 1, ae) be the unconditional limiting probability that 
the system is in state (i,j) and decision y is made, that 


soe 


Tm; .(¥) = Pistate = (1,3) and deci-iene a 


Zs 


Operating on the state space ee eee 1) (ML) t Hence, 


meee et) = n then X,(t) = i, X(t) = j where i,j are given 


1 § 
by equations (3.6) and (3.8) respectively. 


Let Eee) = PLY(t) = n|Y(0) = m} 


P OE) BNO (18) soak (0c) 3 |X, (0) = at. 


where: 


mmc given by Equations (3.6) and (3.8). 


lim P Gc) 
om t->0o M,N 


ie 
D 
ct 
=> 

il 


CS 3 |X, (0) = ey ORS 


lim P{X, (t) ae, 


00 


2 2 | 


Using equations (3.3) to (3.5), the following was obtained: 


Since TT; - was shown to exist and is positive, therefore 


f 


meewas COncluded that u will exist and is strictly positive 


men, O < 7 < 1). 
n 


Let: 


\. be the total failure rate when the process is in 
state n. 


eZ 


z 


O 


O 


iz 


, = = ee a = = 
i | en 1, (Mj+1) (M3+1) (M,+1) 15 (M341) (M,+1) 1, (M,+1) i 
1, = n-i, (Mj+1) (M3+1) (M,+1) (Me+1)-1, (M3+1) (M,+1) (M.+1) 

- 1,(M,+1) (M-+1) - i, (Mo+1) - 1 


Various examples carried out for the various cases and 
the above equations were found to give the correct corres- 
pondence between the set N and the corresponding state space 
S2 

Therefore, it could be concluded that the set of equations 
(3.9) allow us to transform a K-dimensional-continuous-time 
Markov process operating on a finite discrete state space 
to a univariate-continuous-time Markov process operating on 
the fina te, state toedceu = (1 2peeee M ye2)). This allows 
the analyst to carry out all negeenees analysis on the uni- 
Variate-continuous-time-Markov process, using all existing 
theorems and algorithms for the univariate process, and 
then retransforming the results back to the K-dimensional 
process using again the set of equations (3.9). 

As shown above, in the case of bivariate Markov process, 
knowing n, the corresponding state (i,j) can be determined 
and vice versa, 1.€., if (1,3) is Known) Uren mieean ee 
determined. With such observations the bivariate continuous-— 
time-Markov-process can be transformed into a univariate- 


continuous-time-Markov-process. Define the stochastic 


process {Y(t),t > 0} to be a continuous-time-Markov process 


2 5 





1, = hh — i, (M,+1) (M,+1) - i, (M3t+1) - 1 
Mew K = 4; 
i = i, (M,+1) (M3+1) (M,+1) + i, (M,+1) (M,+1) + i, (M,+1) 
_, = =| 
1 (M,+1) (M,+1) (M,+1) 
i, = ee ee ea) = 2 
2 (M,+1) (M, +1) pry, | 
a Saal oe ae 
1, = an i, (M,+1) (M,+1) 1, (M,+1) 1 
ly = n- i, (M+1) (M,+1) (M, +1) - i, (M,+1) (M,+1) 
- 1, (M,+1) - jl 
lee K = 5: 
io = i) (M,+1) (M341) (Mj +1) (Mot) + i, (M+1) (M,+1) (M,+1) 
+ i. (M,+1) (M,+1) + i, (M.+1) + 1, + ]j 
r~ n 1 
at a a ee 
i | (M,+1) (M,+1) (M,+1) (Mo+1) ; 


cial +1) (M 5t1) 


Tk 2b ie #1) +1) 


: 
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1, (M,+1) = 1 | 


1 (M, +1) (M, +1) - 1, (M,+1) - lj 


+ 1 


a 


+] 


Considering 


equations: 


For K = 2: 


different values for K, we get the following 


i, (M,+1) + 1. 
es = 
1 
aD 
n- 1, (Mj+1) 

i, (M,+1) (M341) 
J See 
(M,+1) (M,+1) 

~ ia 
(M,+1) 1 


1) 
M.+1) 
nie 

J We 


IT (M) +1) 


qed. 





toils 


25 


( 


M,+1 


j=241 


) 


m 
I] 


il 


+ 


1 


(M.+1)-1 


= 


+ 


a 


Beye: 


n = i(M,+1) (M3+1) + J (M,+1) +k+1 


Thus, the trivariate Markov process X(t), operating on 
the state space S, can be transformed into the univariate 
Markov process {y(t),t > 0} operating on the state space N 


by using the following equations: 


= 
| 


i(M,+1) (M,+1) + j (M,+1) +k+kl1 


C= | a ere 
(M,+1) (M,+1) 
re ee. ee a 
I oo= a i (M,+1) 1 | 
ic. on, = 1(M,+1) (M,+1) = j(M,+1) - l 


Various trial runs have been conducted on the above 
equations for both bivariate and trivariate Markov processes, 
and found to be correct. This shows that a generalization 
ber a Re variate-Markov process is possible, as shown below: 


: th : 
Consider a K° -variate-continuous-time-Markov process 


X(t) = {X) (t) ,X,(t),...,X,(t)it > 0} operating on the state 
Space S = Veg ot ge Sot) jake = oe ae — ieee, .7 Kk}. — The 
Sardinality of the state space is II (M.+1). 
j=l 7 
K 
foie 2. ee i (M.tl)}. Let n« N. Then: 
j=l 7 
j=l K 
n = } Mm (M,+1) + i, + 1 


ie 
1 J g=j+1 * 


LA 


Therefore, if n is known, then i must satisfy: 


n 


ae 6 ee i < = 
(M,+1) (M,+1) 


(M,+1) (M,+1) 


| A 


Using the same argument used for the bivariate case we 


find thee - 


; n a 
Lie = ee 
aya 


Now, knowing both i and n, we need to determine j. 
lf iv= 0, “then: 

ibe ns (M,+1) then j = 0 

aMae (M,+1) <oe ees 2(M,+1) then j=l 


ile n» (M,+1) Soe (n,+1) (M,+1) then j =n 


Hence: Lik = 0 then 5 = | wey - lL 
5 


Lf a-= 1 Veen: 
at (M,+1) (M,+1) ee oes [(M,+1)+1] (M,+1) then j = 0 


Tf [(M,+1)+n,J] (M,+1) <n < [(M,+1)+n,+1] (M,+1) then j =. 


Hence: if i.= 1, then — aT = (M,+1) = 1 | 


Therefore: 


AD ise eee 


THE CORRESPONDENCE BETWEEN N AND (1,J) 
USING EQUATIONS (3.6) AND (3.8) 


St 


n i = Papsr >} | j= mn =A (Wey a 
1 0 0 
2 0 1 
3 0 2 
4 0 3 
5 i 0 
6 i 1 
7 1 2 
g 1 3 
9 2 0 
10 2 1 
a 2 2 
2 2 3 


_—— O,...,M,;k - 0,...,M,}. yee I 2 eee ely (M5 +1) (Mj+1) 5. 


bet n « N, then we need to determine (1,],k). 


iia gh (Mo+1) (M,+1) ehen, 1 = 0 
igh (M,+1) (M,+1) SiS 2(Mj+1) (M,+1) clelSi¢ teak 
<aetl 9< (nj +1) (M,+1) (M +1) them.  10=7n 


et n, (Mj+1) (M3+1) 3 


LA 


n = i (M,+1) + 7+ 1 (3a) 


Tine "= har el ae =] (oo) 
To illustrate the above, consider the case where My = 2 
and M, = 3. A graph of the state space is shown in Figure 


. 


(3.1), where each state is numbered by n and the corresponding 
(i,j) values. Table (3.1) shows the correspondence between 
n and (i,j) computed using equations (3.6) and (3.8). Examina- 
tion of the table shows clearly the usefulness of equations 


(3-6 sands (Ss com 


(2,3) 
ener 





Figure 3.1. A Correspondence Between n and (1,)j) 


To generalize the above mapping, we derive equations 
similar to equations (3.6) and (328) ten Ene casesorrs 
trivariate-continuous-time Markov process. 

Consider a Markey peecess eae {X, (t) ,X,(t),X,(t)it Boe) | 


Operating on a state space S = 1 (ijg, ) te oper ae 


ila ie 


and if 2(Mj+1) < n < 3(M,+1) then i= 2 


2 


Hence, if n,(M,+1) <n < (n,+1)(M,+1) then i = 
The general form is 
i (M,+1) <1 (it+1) (M,+1) 


Gii-sertore, if n is known, then i must satisfy: 








< 
M. +1 — M. +] 
Note that i must be integer. Therefore: if 
v is integer, then i = ~~“ ~-1 
M, +1 a M, +1 
2 Z 
Suppose that rv ot is not integer, then: 


where [X] is defined to the smallest integer > X, and |X| 


Mm@embargest integer < X. But, 





Therefore, 


Let S be the collection of all possible states for the 


process ROS) eG (oe) ae SS Aes 


S..= 40a ee ee 


We 2 
The cardinality Of "the see So 32s (M) +1) (M,+1). When the process 
is in state (i,j), there are f(i,j) = min{a,M,-i,M,-3} 
Operational aircraft. Therefore the commander's objective 
stated mathematically is: 
max _ £(i,j)"y 5 
auld “Cra (lees 


where y(i,j) is the action taken whenever the process is in 
State (2700 

To compute the Scull repair policy, two optimization 
approaches will be used, linear programming and dynamic 
programming. 

To simplify the notation, it may be observed that a 
one-to-one mapping between the set N = {1,2,..., (M, +1) (ie 
and the set S can be defined. Figure (3.1) shows a corres- 
pondence between N and S. Let neN, and (1,3) « S. We 
need to determine the values of i and j if n is known. We 


note that, 


Te ala S M,t+1 Cheney aa — 0 


ene act Mot+1 <0 2(M+1) then 1-= 1 


ele 


All policies to be considered are stationary policies. That 
is,whenever the process is in state (i,j), the decision to 
be made is the same for all values of t. 

The objective of the maintenance commander is to maximize 
the squadron readiness, which will be measured, as stated 
Alternative measures are possible, and may even be more appro- 
priate. To obtain a mathematical expression for the commander's 


objective, define the following: 


Let L siggy = rapes Ev then (354) 
(en Me Ge) (Si)) 
1) +00 J 
me, , fm ene limtting probability of observing the 


1, 
eeetem to be in state (1,)j). 

All states of the Markov process defined by (3.2) com- 
municate, so the Markov process is irreducible. Hence the 
limiting distribution exists and is independent of the initial 
condition. Since every state iS a positive recurrent 
State, the limiting probabilities nM. ; are all positive 


a 


Miemtotm a probability distribution; (i.e., 7. ; a Ors 


1G 





If Shop 1, where repair of Type 1 module is conducted, 
has Ry repairmen assigned, where 0 < Ry < R, then the tranei- 


tion probabilities are, te™terms Cf Oracueca.- 





c aR Oue Probability 

(isa -- (i+1,3) Py N min{a,M,-i,M,-jidt 
> (i,j3+1) Py dA minfa,M,-i,M,-jidt 
> (i+1,3+1) Pioh minta,M,-i,M,-j}dt (3. 
= (i-1,3) Wy mintR, ,ijdt 


> (i,j3-1) min{R-R, ,jidt 


The above assumptions and formulation specify the sto- 
Chastie omecess PGS) p25 (Se > 0} as a bivariate Markov 
birth-and-death process. The limiting probability exists 


and can be found by solving a system of linear equations. 


G. DECISION MODEL FORMULATION: A REPAIR POLICY 

A repair policy is a rule for making decisions after 
observing the system. The policies that are considered in 
this study are the type of policies that depend only upon the 
observed state of the system at time t, {X, (t) ,X,(t) I, eta 
the possible decisions available, where decisions can only 
be taken when the state of the system changes. Therefore 
each policy can be completely characterized by a vector that 
prescribes the decision to be taken when the system is in 


State (1, )71= O,1,.--,M); j= Oyler The components 


5° 
of such a vector represent the number of repairmen to be 


assigned to Shop Type 1 when the system is in state (i,j). 


BPA) 


foe PROBLEM FORMULATION 

@Bonsider an aircraft SquadteeteeicdescCOnSIStS Of a number, 
a, Of failure-prone aircraft each susceptible to failure from 
one or both of two causes. Let A denote the overall Markovian 
failure rate of an individual aircraft, and let Py denote the 


Semattional probability that a failure requires just Type l 


(es9., engine) repair, P. the conditional probability that the 


2 


failure is of Type 2 (e.g., communications) and Plo the condi- 
tional probability that both Type-l and Type-2 failures occur. 


Thus, P, + Pj + = 1, and the sequence of successive failure 


|, eee, 
types is one of independently and identically distributed 
random variables. Suppose that there are M) and M. modules of 
Type 1 and Type 2 respectively, assigned to the squadron where 
min{M, ,M,} meee eee Rance denemedssigned tO the squadron 
where each repairman is capable of repairing both types of 
modules. 

Next, let X.(t), i = 1,2, denote the number of modules 
SieType 1, 1 = 1,2, that are in or require repair at time t. 
Thus the number of operational aircraft is min{a,M,-X, (t), 
M,-X, (t) } where it is assumed that an aircraft requires both 
modules (one of each) to be considered operational, and this 
is the number of aircraft that are failure-prone; the others 
are awaiting one or both of the Type-l and/or Type-2 modules. 
memally, it is assumed that repair is Markovian (or exponen- 
feral) : Wy denotes the rate at which an individual repair 


Seelype 1, 1 = 1,2, is completed at Shop 1. 
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The repair process factors include repair time (diag= 
nostic, removal of module from aircraft, ordering parts, 
repair of a failed module, testing of a module after repair, 
quality assurance inspection), and the queueing discipline 
used in the shop. For example, first-come-first-serve, ora 
priority system may be employed. 

The major factors affecting the assignment decisions 
are the number of modules down requiring repair of each type, 
and the number of repairmen assigned to the maintenance organi- 
zation. Therefore, the maintenance commander has to choose 
one decision among a finite set of possible decisions while 
considering the combat effectiveness of the squadron. The 
combat effectiveness of the squadron during peace time (be- 
tween combat occasions) can be assumed to represent the readiness 
of the squadron at any point in time, which can be represented 
by the expected number of aircraft ready (or up) to engage in 
combat at the time the squadron must respond to an attack. 

This chapter presents a mathematical model that will 
identify an optimal repair policy among finite feasible poli- 
cies that are available for the commander to follow. As will 
be seen, the policy is idealized so as to allow calculations 
to be made. It does not recognize all reasonable constraints 
to which the repair system is subject. Nevertheless it, or 
its extensions, should provide some useful guidance for a 


Geciesion maker. 


US 


The two major factors affecting the repair policy 
are the failure rate and the repair rate of each type. The 
failure rate of each type of module depends on the number of 
aircraft, the failure rate of a module, the conditional proba- 
bility of the module failing given an aircraft reported failed, 
mamene total number of spare modules available. 

The repair rate of each type is a function of the 
repair rate of a single repairman or team, the number of 
repairmen assigned, and the number of modules of the same 
type down at a given time. 

These two major factors will be considered in analyzing 
the repair policy in this chapter. 

Peeekepalirmen Assignment Decisions 

The repairmen assignment decisions are the responsi- 
Paity of the Peninicerames commander (supervisor). The decision 
concerning the number of repairmen to be assigned to each 
repair shop when the state of the system changes should follow 
a (nearly) optimal repairman assignment policy; such a policy 
Mmeeteorred tO in this study as the repair policy. The factors 
affecting the repair policy can be classified as: 

- dependent upon the logistics system of the squadron, or 
- dependent upon the repair process. 

The logistics system factors include the availability 
of maintenance tools, documentation, preventive maintenance 
program, spare parts when needed, quality assurance program, 
SmGemany Others. In what follows the influence of such factors 


peel be left implicit. 


ia 





E. PROBEEM CHARACTERIstl Ves 
The problem is characterized by these main aspects: 
- Demand process. 
- Repair process. 
- Repairmen assignment decisions. 
l. Demand Process 

The demand process depends on factors that include 
number of aircraft in operation, number of pilots assigned, 
probability of failure of modules, possibility of a simul- 
taneous failure, i.e., resulting ina ST ances demand. 

2. Repair Process 

The factors affecting the repair process can be 
categorized as: 

- Factors related to the maintenance organization. 
- Factors related to the operational organization. 
= “OGtEner faces: 

Maintenance organizational factors include the number 
in various skill categories of repairmen, the location of 
different shops, rate of repair, availability of tools and 
test instruments, and the cannibalization policy. 

Operational factors include number of aircraft assigned 
to the squadron, type of missions the aircraft are conducting, 
pilot skills and training, failure rate of the modules aa, 
stalled, and the sortie frequency. 

Other factors include weather conditions, foreign 
object damage (FOD), manufacture or urgent maintenance bulletins, 


changes in type of threat, and number of spares available. 


ilgitelh 


mepmesenting state 1. The dimensionality of y (i) depends 
on the type of actions considered. 

For example, if { (X, (t),X,(t),X,(t),X,(t)),t > 0} repre- 
sents the number of modules of types 1, 2, 3 and 4 down, 
respectively, and the action to be determined is the total 
number of repairmen to be assigned to the maintenance facility, 
1.e., the repairmen are assumed to be capable of repairing 
all types of modules, then y (i) is a scalar. More realis- 
tically, suppose that the supervisor iS assigned R repairmen, 
and the action to be taken is to distribute the R repairmen 
among the four shops. Then y (i) is of dimension 3. The first 


component of y (i) will be R the number of repairmen to be 


i is 
asSigned to Shop 1. The second component is Ros the number 


of repairmen assigned to Shop 2, and the third is R the 


37 
number of repairmen assigned to Shop 3. Ras the number of 
repairmen assigned to Shop 4, is the balance, Rs R- (R]+R5+R2) 
and need not be a component in the vector y (i). 

Bacrerore, MF a stationary policy is employed then the 
sequence of states {X¥(t),t > O} where X(t) is a vector, forms 


a multi-variate continuous-time Markov process with a transi- 


meen probability P. Pree = Pp, 


“ 4 (try (i)). As in the univariate 
: 


case there will be a unique infinitesimal generator for every 


policy to be considered. 


oO 


{X(t),t > 0} forms a continuous-time Markov process with a 


transition probanwlieys 


Bae) = eo ae : (219) 
The evolution of the system from state to state described 


by P (t,y(i)) depends on the infinitesimal generator whose 


1,j 
elements are q(jlji,y(i)), j = 1,2,-..,M, where 0 < q(j)|agssg ee 
j # 1, is the rate of transition from state i to state j when 
decision y(i) is employed, and q(ili,y(i)) = - , qg(j/2y ae 
i=l 
We 

Therefore a collection of the row vectors q(j/i,y(i)) 
for 1 =1,...,M will form an infinitesimal generator that 
uniquely determines a continuous-time Markov process. That is, 
the probability is q(j/i,y(i))dt + o(dt) that the systema 
be in state jJ at time t+tdt, 0 < dt < 6, 6 > 0, given) =i eee 
in state 1 at time t and action y(i) « Pr. is always used in 
the interval [t,t+é6) when the system is in state 1. 

The preceding statement can be generalized for the multi- 
variate-continuous-time Markov process. A state can be repre- 
sented by a vector whose components are the states for the 
marginal-continuous-time Markov process. Let m be the 
cardinality of the set of all possible state vectors; then 
the system can be found in one of m possible states labeled 
1,2,...,m at any point of time. When the system 1S i1ngseae. 


* a age ry r a a e 
1 an action y(1) is chosen from a finite set Tye The dimen- 


Slonality of y (i) need not be the same as the vector 
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The vector whose components are X(t) for all K types of 
moaules installed on the aircraft, is taken to be the state 
of the system. Because the probabilistic nature of the 


system state changes, the process X(t) = {X, (t),..-,X Cie. 


K 
t > 0} represents a multivariate stochastic process. It 
will be assumed that the state of the system at time (t+S) 
given the history to time t 1s a function only of the state 
at t, so the process can be handled as a multivariate- 
continuous-time Markov process. If the supervisor is able 
to make a decision on the required number of repairmen to be 
assigned to every shop, every time the state of the system 
changes, then the problem can be formulated as a Multivariate- 
continuous-time Markov decision process. Although it may be 
unrealistic to assume that the personnel are so rapidly inter- 
Changeable, this is the situation that 1s examined. 

Consider a system, S, which at any point of time must 
be in exactly one of s possible states, labeled 1,2,...,s. 
Suppose S operates from time zero to time T, where T > ~,. 
When S is in state i, an action y is chosen from a finite set 
Ps of possible actions, and the return rate is f(1i,y) that 
depends only on the current state and action taken. 

The policy is assumed to be a stationary policy. A policy 
Pmaatlad to be stationary if it is non randomized and the 
decision it chooses at time t depends only on the state of 


the process at time t (Ross, 1983). It follows that if a 


stationary policy is employed then the sequence of states 
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Gee SCOPE 

An air-interceptor squadron is selected to represent the 
operational situation under study. The squadron is considered 
to operate independently of other squadrons. An aircraft re- 
quires a certain number of its systems to operate in order to 
be considered operational. The shop supervisor is assigned 
R repairmen capable of repairing all types of systems installed 
on the aircraft (1.e., general technicians). 

This study concentrates on finding the optimal way of dis- 
tributing the repairmen among different shops. Here the term 
"Optimal" refers to the maximization of the readiness of the 
squadron. Ultimately the readiness of the squadron is assessed 
by its ability to engage into air combat when called upon with 
the maximum number of interceptors in an attempt to minimize 


the number of enemy bombers reaching their targets. 


D. APPROACH 

To achieve the above objectives, the repair process of 
the squadron during peace-time or non-combat periods has to 
be analyzed. The effect of the repairmen assignment decisions 
constitutes the restrictions for determining the optimal repair 
policy. When an aircraft lands, the entire repair shop com- 
plex experiences simultaneous demands for several different 
types of repair. It is assumed that an aircraft consists of 
several types of systems; for example, engine (propulsion), 
communications, airframe systems, etc. The system is referred 
to as a module. Let the number of modules of type i down for 


repair at time t be WSU ME) = Oise 


Oy 


Ill. FORMULATION AND ANALYSIS OF A PROBLEM IN REPAIRMEN 
ALLOCATION FOR AN OPERATIONAL LOGISTICS SYSTEM 
oe LNT PRODUCTION 
This chapter models a repair shop maintenance process for 

a given aircraft squadron. The model formulation is based on 
a stochastic continuous-time Markovian decision process. 
Mathematical programming optimization techniques are imple- 
mented to determine the Optimal repair policy. After this brief 
introduction, the objectives of this chapter will be presented, 
followed by the scope of work. The problem characteristics 
will be introduced, followed by the assumptions used in the 
model. The model is then developed, and sample solution of 
the model, using dynamic and linear programming techniques, 
ape analyzed and verified. The optimization techniques are 
compared, and potential opportunities for improvements are 


suggested. 


ee OBJECTIVE 

The objective of this chapter is to formulate and analyze 
a repair policy for an aircraft squadron. Analysis of the 
repair policy means determining the various repair policies 
available to the shop supervisor, defining the effect of each 
policy on the squadron readiness, and selecting that repair 
policy which maximizes the expected number of aircraft ready 


to engage or "scramble" when an attack occurs. 
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From equation (2.35) the expected probabilities for 


the number of modules down at the time of attack become: 


State: {1,j): (0,0) (0,1) (0,2) (1,0) (1,1) (2,2) 270) 2 eee 
EL; 5 (W)] ; .9825 .1269 .0170 .1433 .0491 .0074 .0570 [017 soci 
Hence, from equation (2.36), the readiness is given by: 

Pi D(0) = 70 ae. 0 rae 

PLD (0) = 4 = eo 22 


The example was used only to show a simple applica- 
tion for the method of computing the operational readiness 
of the aircraft-sgquadron using the matrix geometric approach. 
The results obtained were compared with the results obtaunm 
by writing down the generator and solving for the limiting @aaes 
tribution, and for the Laplace transforms. The results obtained 
were the same as those obtained using the matrix geometric ap- 
proach. The matrix geometric method has the attractiveness that 
at any time we are working with small-size matrices, which 
allows for solving a large-scale problem. As shown before, 
if we are considering a system with Mi, > ee 100 moduleee 
then the infinitesimal generator will be of size 10,201 x10,2019 
which is too large to calculate the limiting distribution ad 
Laplace transform by solving TQ = 0, ne = 1 directly. sUsaime 
the matrix geometric approach, we can only work with matrices 


of size 101x101, which are mu@e smaller. 


Ors) 


The following are the values for mT 


=, 3) 


(0,0) 
(0,1) 
(0,2) 
(1,0) 
aL) 
2) 
ZO) 
2,1) 


2,2) 


55:70 
m2 /0 
4296 
Ba oL2 
4179 
FOOLG 
3541 
25068 


5 RS 


(0,0) 


ey 
0867 
0194 
EOOT5 
0412 
.0094 
50398 
0134 


0018 


0640 
pooe2 
-2818 
0496 
sla67 
oO 
S(O SSH 
~0759 


0220 


(0,1) 


0214 
0568 
SOUZ7 
0085 
20155 
0044 
10057 
0033 


0006 


0032 
0165 
wa 32 
0026 
B0099 
0666 
-0018 
0047 


S027 


(0,2) 


“OGL 


n0O27 


.0096 


.0004 


0010 


20017 


0002 


0002 


0001 


-0637 
SUS0)s 
0404 
- 3488 
SO 
s JUNE 
2325 
Alls) 3) 


lel o 


(Ele) 


nO 
-0082 
.0018 
0601 
0 Ea> 
0026 
0262 
0068 


.0008 


ers, 


nOZU 
0257 
30238 
0284 
SAAS 
21283 
ORGS 
20926 


0896 


(1,1) 


0073 
0048 
TOOIRE 
.0049 
“OVANUG, 
30055 
20021: 
.0040 


.0006 
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(1,2) 


Pema: Ig 


(1,2) 


“0005 
- 0010 
- 0002 
0003 
.0009 
H0089 
-O00L 
0002 


0003 


0058 
0051 
0040 
70239 
-OL9G 
20125 
ESISVAS 
.1490 


0887 


(270) 


sOO19 


- 0008 


0002 


0050 


. 0020 


0003 


20297 


0065 


0006 


0024 


0025 


- 0020 


.0084 


0141 


0086 


0056 


- 2079 


wae 


(nm). 


(271) 


.0008 
.0004 
0001 
0014 
.0014 
-0002 
0006 
.0090 


0008 





-0003 
0004 
- 0003 
-0004 
-0030 
-0018 
0003 
OOS 


1441 


(22) 





2 
Oo. some ae 
2 0 0 
E, = Bo = nie 2 -5 0 
0 ae 5, 
| = 222 0 0 
ES =) | eee 23 0 
| 
fea 0762, =ob143> Seniave 
oon oA 0 
ash 5. ole ee _ 2 
E) ppg Ces Ie qs 2.0686 5.3971 OG 
0 4 a 
SSH, a 005 
Bee = -.121 -.1954 -.0064 
=. 0692. ae 7 Tees 
=e 3S 216 LAs 0015 
s 3 ed ee bey = - 
Eg: Bo + Catal ee AVE DT: 3.3995 2399 
0 4 =5 


Using Proposition (2.4), we get the following value ren 


as 
~ 


P Gn. 


ears (ares ares 
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Hence, the matrices F Peay =: (OL glean G 


_ ae) 
Go 
ec mm) (0) ilo) Gia a 
7 (F +G. )o+ G., A + poF 
B, = oe +c, +c.) - ee 
Meee SC (2) (2) (2) .b | 
B., = (Ga +G, ) + Go A = 
a eee BO) 
Co = p,F + Pi9F A = 
a a a 8 ~(1) a 
C) = p,F + PioF A 
> lg 
E _ A ee 
Di = Gy = 0 Z 0 
0 0 2 
IS 72 


men = O,1,2 can be determined using the above rates. 


mmo 


Hence, 


II 


P{D(0) OU awa mere 
and 


P{D(0) ioe oes 


lI 


Assume there is a warning that is exponentially 
distributed with mean = 1 day. The failure rate during this 
period drops from i} = 1 aircraft per day to A‘t = 0.5 aircraft 
per day, and uy = it U5 = 1 modules per day increase to Wy = 23 
U5 = 2 modules per day. To find the readiness at the time of 
the attack, we need to determine the parameters of the new 
stochastic process (X, (€) ,X> Ct); t > 0}. The rate parameters 
are state dependent as follows: | 


ad ~e ~e 


State PaCaee g, (1,3) Gy (1,3) 
(Taal) 

(0,0) s 0 0 
(07) 5 0 2 
(0,2) 0 0 4 
ie. 0)) a Z 0 
a ) 5 2 2 
tla) 0 2 4 
be OD 0 2 0 
(ZL) 0 2 Z 
(2725) 0 2 4 





INGE 


To renormalize, 


> 
b = T,e€ + 7,.€ = 1.5497 


Therefore, dividing by b we obtain: 


ig = [.3985 .1927 .0541] 
-> 
ee ec! oe ese 0312) 
> 4 > 7 -] a 
ee eee) aul 1345 50520 
To renormalize, 
2 
> 
eee) eee) ee el Oa 
1G | 
n=0 


Therefore, we obtain: 


ii ST eeceeesied4) 9904S) 
=> 

fi = | eles (0957 OeGu! 
To Si SEOs c58 LAO0Ge | 


Therefore the readiness is: 


2 
oie Ofu— ) 


nOO 7 9 











— — pa . ll _— — — 
H, = By = it 2 0{; H, = 0.5 0.5 0.0 
0 9 (ee -0.333 =0.333 =(meee 
oa peat (ees puaee 
ies o25 0 \0uueal 
= eee! a _ 
H, = B, + C)(=nee) Doe leiGGe 2.7333 0. Meee 
0 D Be 
eae | 
Therefore: 
=.8074 = 1667) Sees 
Tl 
fa f= Wipe . 2.3 = Ogne 
= 2815,. ==.333 Senses 
, 2. 
SoG 5667 .025cmme 
_ ae = 7 
ee een 1B. = ieee 1.7333  5oem 
; 2 oa 


From Proposition (2.2), we get: 


oe One ge = ol 
Therefore: 
T 9 = (26175. 62967 ee onl 
ee ae 
T, = “WG (erie) [3188 .1e2emeeorlioes 
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B= PF eee AS = 0 Tz 
0 0 0 
0.4 OFZ 0 
2 a) es) a 
Cy = p,F + Pi5F A 0 0.4 OZ 
0 0 0 
a (1) . (2) 


Hence, the infinitesimal generator, Q, becomes: 


OO ee Oi) (O72) lO) yt 2) (2,0) «(2,1) (2,2) 


foray | -1 0.4 0 we) Ose 0 0 0 0 
oo | 1 -2 0.4 0 0.4 0.2 0 0 0 
(0,2) 0 Zz = 0 0 0 0 0 0 
(1,0) | 1 0 0 a, 0.4 0 D4 yee: 0 
mee (1,1) | Oo 1 0 i “8 0.4 0 0.4 0.2 
a2) 0 0 1 0 2 = 0 0 0 
(2,0) : 0 0 0 i 0 0 = 0 0 
eh) 0 0 0 0 1 0 1 =2 0 
(2,2) 0 0 0 0 0 1 0 2 = 


TO compute the limiting probabilities, we need the 


mo LLOWwing: 
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Let 


Heb Gua Olen 
aE oor | | ae = 1 oO 0 
0 0 oO 0, WEInO 

aa! Ds ah 


Let Q be the infinitesimal generator for the process, 


Therefore, using Preopesite On eZ eerie. 


Be. Cams 
os i ed 
0 sled 2 


where: 
—| 0.4 0 
a ee Oey (0) (QO) _ 
Bye Ee ee Cee eee 1 2 0.4 
0 2 -2 
-2 0.4 0 
Ea Bybatarvelte Wolo yrs es cs igh a) = ny -3 0.4 
ik 2 2 2 
0 2 -3 
tee 22m 
a a 
-l @) 0 | 
ec) C2)P ae : 
B. = (Gy +G, ) + G, a : i 2 0 
ae 
= nese 


OF) 


Let: 


ee (TE = {P,,(t),P5, (t) P55 (t)} 
2 Ce) = ele aag (2) oaeaeye 
Py tt) = {Pg (t) Poy (t) » Poo (t)} 
: ; ; ; (n) (n) 
Define the failure and repair matrices F ; G, and 
om as follows: 
1 0 0 ih 0 0 
p 60) = 0 1 CEUaEe ge - 0 1 0 
0 0 0 0 0 0 
tk 0 0 1 0 0 
J) Li) es 
G) = 0 al oe aa Gy = 0 1 0 
0 0 i 0 0 1 
and 
0 0 0 0 0 0 
(O) _ (10) ie 
G. = 0 1 OF G. = 0 it 0 
| 0 0 2 0 0 2 
0 0 0 
(4) 
G5 = 0 i 0 
0 0 iv 
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| | 


=~ 
—> 








Figure 2.4, Transition Rates: A Simple Example 
to Illustrate the Matrix Geometric 


Approach 


vB 


ee oie ee xciyeve tO Illustrate the Proposed Technique 


Consider one aircraft in operation. Suppose the air- 
Craft is operational if it has both engine and avionics 
systems (one of each) installed and in operating condition. 
Suppose further that there are a total of 2 engines and 2 
avionics systems in the organization. Both engines are 
assumed to be repaired by an engine technician that is not 
capable of repairing the avionics system, and can only 
work on one system at a time. Suppose that the organization 
has a single engine technician and 2 avionics technicians. 
Let 4 = 1 aircraft per day be the total failure rate of the 
aircraft, the pilot reports failure due to engine with proba- 
Delaity Pp) = 0.4, and due to avionics failure with probability 
Po = 0.4, and due to a failure of both systems with probability 


1 engine per day be the repair rate of 


II 


Pi w26) Let Wy 
the engine, and Hy = i avionics systems per day. 

A graph of the state space and the transition rates 
for each state of the process {X, (t) ,X, (t); t > 0} is shown 
moe rgure (2.4). 


Consider {X, (t) ,X, (t) ; t > 0} as a Markov process on 


the state space {S5,S81/S_} aesmcdet med be Low - 


WY) 
II 


LCP 2 IE A 22) 


2 
S, = feel) merle le ame lee 2) 
Ss OO) aecOrmay amo, 2) 5 


94 


~ 


( 
. . LS ‘ | 
Oe 1 = a a ne an ey) (2.3 


Neen nines 
n=0 m=0 / rtd 


Hence, the readiness probability distribution is 


then Given dey. 


"pe ne - 
E(P. + E(P, , .(W)] O<k<a-l 
i,M,- Se 5 0 My erg 
M,7a =a . 
PD O).— ks) ) > E{P,. (W)] k=l (2.36) 
i=0 j=0 YJ 
0 otherwise 


In terms of the Laplace transforms the above 


becomes: 


i ee 
a) eS) ee ; (r)) 
b vd — 
= 0 MOO ee K 
M,—-k-1 7 - A 
—— Ts ee Tee eo i (2, 3am 
j=0 n=0 m=O a n,m;M) kJ 
Os Kk < acu 
7 ul least °4 ; (n) k =a 
0) 3=0 n=0 m=0 FM Vie ee) 
? otherwise 
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The readiness probability distribution can be 
calculated by solving for P{X(W) = i,X(W) = jlw}. 


Pacieenemlaw Of COtale probability 


ps , thy Ny og : 
Bee) — i,X(W) = j[/w} = ) )} P{X, (Ww) = ie 
n=0 m=0 _ 7 
X, (0) = n,X,(0) = m|w) 
M, M, : - - : 
= [ J ptx,(w) = i,X,(W) = 3/X, (0) = n,xX,(0) = m,W} 
n=0 m=0 
x P{X, (0) = n,X,(0) =m} 
Therefore: 
2 2 as 
Bix (Ww) = i,X,(w) = jlw} = JY 2) P{X, (w) = i,X,(W) = j 
n=0 m=0 
x, (0) n,X, (0) = m,W}t r 
ees) 


Since eg is non-random, taking the expectations of 


f 


both sides of (2.33) with respect to W, gives the following: 


a2 





and 


5 hy i Pnm,iq 
Let 
P_(s) = Png (2) ing * 2) 7 emer 


Using Proposition (2.4), we find that the vectors 

for the Laplace transforms for the new, restricted, bivariate 
=e 

birth-and-death process, {X} (t) ,X, (t); ie (0 eS) n =—0, i. 


-+2/M), can be determined, where: 


£(n,0) | 


pin) = ~ 
, £(n,M,-1) | 
0 | 
g, (n,0) 
See) 
(nN) _ rile res 
SF) = Ses 
ae | 
| g, (nM) 


sal 


To find the readiness probability distribution at 
the time of attack, it is required to find the number of 
modules of both types down at the time of attack. 

Let Pam, ig be the conditional probability of 
the process being in state (i,j) at W (i.e., when the attack 
Meeurs) given the process was in state (n,m) initially, and 
that W is exponentially distributed with mean aa? Therefore, 


~ 


nm, ig) = PLX) (W) = i,X,(W) = 5|X, (0) = n,X, (0) = mw} 


Now, note that 


ifeeeollows that: 


So, aS in the case of the single-module model, the required 
Mmeaaaness 1S given in terms of the Laplace transforms. 
imuichiMGmmwhat solleows, for Simplicity of nota- 


tion, we will suppress the initial condition and write, 





i. 7 a. a a 
£1 79) ae) minia,M, i,M, 33 


- ( Hj2 neler 2 Nee 7R ol 
WyRy 1 = Riv - 7M, 
: H5J Ince 7Ro-1 
g.(1,)) = 
Ceo 4 ae 


The initial distri buc tone iten {X) (t) ,X, (t) ; t > 
is the limiting distribution for {X, (€) X(t); t > 0} with 


parameters ji, Uys and Hos given by Proposition (2.2): 


P(X, (0) = Gp x5 0)) a ee es me (2.329 


~s 


Therefore, {X (t) , X(t); t > 0} is a bivariate 
birth-and-death process, with initial condicirons 7. j fons 


Gio Se. Wied 


~ 


nm, is ‘©? = eS et eye et et J |X, (0) = n,X,(0) = m} 
and Pait,ij >” denote the Laplace transform for Pam i Saae 
Then, 

= “ =st 
ee ae J eT Pin ig (tat 
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1 2 
oe lt ) ie Oe ke < a-1 
fon» +2) 12>" =o 2 °- a 
: Mj-a Moa 
P{D(O) = k} = ) ) oT. . k=a (2220) 
i= JO 02 
0 otherwise 


This assumes that attacks occur infrequently, so 
a steady-state distribution prevails, and that there is essen- 
tially no warning. 

b. Partial Surprise 

As in the Single-Module model formulation, 
Suppose that the intelligence data suggests that the enemy 
will strike after W units of time (e.g., days). Let W be a 
random variable exponentially distributed with mean ao 
Assume that during the time W the failure rate decreases from 
X to XA4' where »X > iX', and repair rates increase from Wy and 


| ? s | | 
U5 EO Wy and U5, respectively, where Wy < Wy and. < U4: 


2 
mee {X, (t) ,X, (t) ; t > 0} be the number of modules 
of Type 1 and Type 2 down at time t. The process {X, (t), 


X(t); t > O} is a bivariate-continuous-time-Markov process 


with rate parameters: 
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We have proved the following proposition. 


Proposition (2.4) 
> 


The vectors P(s), n = O,1,.--,M,, given that the 


process started in state (1,j), are given by: 


A lee =] 
Fete oes Da Se Base 
Q=] 
> > 
P..(s) = PB (s)C eae 
i-k i-k-1l -k-l i-k 
k 
-] -—] 
+ e.[-E, DS De ee eae 
R=] 
0 < k = i-l; te GE eS M, 

Pits) ~ Pi-1 $8) ©,_3 [HE 


The readiness distribution can now be computed. 
at,.- Total Sunrprerse: 
Under the Two-Module Logistics formulation, with 
a total surprise scenario, a readiness distribution model can 


be derived as follows: 
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mee (2.29) we obtain: 


Bd x K K i 
SP,_,(s) = P._5's)C;_, + P;_)(s)B,_) + Pj_) (s)C,_, (-B, 71D; 
7 e.{-E./)p. 
J 1 aE 
> -- 
A - A ae Sal ee 
Mee eg) Sy IeEs ey tHE, 10; t-E Sy! 
ijererore the statement is true for k = 1. Suppose it is true 


Poe — mM, O< m< i. We need to show that it is true for 


k = m+tl. From the induction hypothesis we have, 


x ~ -1 an et all 
Pa-m(S) = Pym §S)Cgomea Eyam) + gf By TP Pings! OPi-2! 
feeek = mtl, using equation (2.18), 
=> 
i K A a 
Se=m-1 ‘©? 7 eneo) See 52 Pi wet, 8 ae “ Pian Sean 
x ne 
ee ee ene) ama 
a -1 
. a gon SS Say Ee ase 
m 
eo -pol 
ee een ene gy (Ps 9) Pi ty 
L=1 
Mimerefore: 
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> 


For the vectors from n = My down to n = itl of P(s), 


we can use the results from Proposition (2.3). 


> > 
ran _ “w = — ile _ : 
P_(s) = ee Se | ie |. “Beran = itl,...,M, 


Now, applying the argument in Gaver, Jacobs, and 


Latouche (1984) to equations 42223) ye we oscar. 


= a4 x a 
sP.(s) - a2 = P._,(s)C._y + P,(s)B, + P, 1 (s)D. 14 
Therefore: 
— > 1 
ras ze: “An b alk = — 
P.(s) P._,(s)C;_4 | Eee e, | E. ] (2 
Mathematical induction can be used to show: 
me os =I 
Pee 2 Pe eee ee eee 
Kk 
= -1 
+ e2 [=E2 |) eo [Bea 
7 a a=] ++ Q+1 eee 
fOr 0 sFiggowe 
To show that the statement is true for k = ll) item. 


that from equations (2-23) wevebesn- 


- > 
(s)C, 5 > Pals) 2 ee 
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Multiplying the first line in the above equations by 
=-l, and adding the normalizing equation, we obtain the equa- 
tions for the vectors Ta, i O,1,...,M,, given by Proposition 
(2) . 

Proposition (2.3) can only be applied if the process 
started with probability 1 in state (0,0). However, the 


analyst may need to calculate the Laplace transforms for 


the process with different initial conditions. In particu- 
lar, suppose one has positive probabilities PiX, (0) aie 
peo) = WoetOr all states. 


We need to generalize the above results to allow for 
emer Starting conditions, in particular to allow considera- 
tion of the partial surprise scenario. 


Given the process started in state (i,j), 


P.(0) = e, SO ey 22.5905 
and 
P, (0) = 0 EOurallivother k, 
poere: 
Swe OU ee ONO we | 0) j3 = 0,1,...,M, 


The jad element of 25 is equal to 1 whenever the 


process starts in state (1i,)j). 
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e = (1 O , eo} 


and Boe Co! and D, are as given by PEOpOsition (Zaa@ 
Proposition (2.3) can also be used to find the limit- 

ing distribution as follows: 
—~ > K 
TT = lim P {2} = Linesee(s) 

n 
t 00 s>0 

->- 

Now, multiplying the equations for P_(s) given by 


Proposition (2.3) by s and letting s + 0, we obtain: 


> 
lim SP (s) (-—B a1 == him sea 
s>0 0 £ s>0 0 
and 
—> > =4) 
iain SP, (s) heir SP eo) on ae ] 
s>0 s>0 
Burt: 
Ea see =H 
n n 
a 


Therefore we get: 
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iieenieweese fe=—m0, we ©Gbtain from the induction 


hypothesis, 


S@eselttuting into the first line of (2.27), we get: 


SP, (s) 5 P,(s) By + 2 (Sy I, 
By (s) [-(By+C,[-E)"]D,-sI] = e, 
Py(s) [-E9] = € 


We summarize these results as Proposition 2.3. 


Pigepesition (2.3) 
— 


The vectors P_(s), n = O,1,...,M,, are determined by 


the equations: 


Py (s) [-E)] = =) 
> > 
”& aw“ _ i 
Eas) Das) Cael ad 
where: 
E = 6 
ol ol 
eC! | ao sI 
ee n n fee ne 
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We have shown (equation 2.28) that the statement is 
true for n = M,- We will again prove the claim by induction. 
Suppose that the statement is true for n= 1. We will show 
that it must also be true for n = i-l. 


For n = i-l, we get, from equation (2.22) that 


+ * = 
P.(s) P._, (sic; i! ES ] 
Therefore: 

+ ~ 2 + : 
SP;_7'5) = Pi_o(sl€i_5 © Fi) (SB) ee 
ea 7 ol 7 - B¢ 
By OS) Be oy ee eae 

Hence: 
S(t Be Ae 
gp Sa) Sa ee eae eee 
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> 


SP, (s) =o Py (s) By + P, (s)D, 
ES F< a x 
SP (s) = - 1 (sic 1+ elisa’) <- Ee gyal) <1 a2 7) 
sP, (s) P (s)C +P. (s)B 
M, M,-1 My 1 M, M 
where Eo represents the initial condition 
Be 
Py (0) = (1900 ...9-0) = eo 
Thus, we obtain: 
Py (Ss) [sI-B ry Py. -1'S)&y -1 
a K =) 
pM che = Pu _, (s)c, se (22 3) 


where: 


E = 28 = Ss i 
oa aT 
We claim that 
ga - 4 al 
where: 
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e = 0:1, “1a 


and Bae Cat and Dd are as given by Proposition (2.1). 
2. Algorithm for Computing the Limiting Paster abuses 
The following algorithm was used to solve the recur- 
Sive equations given by Proposition (2.2). The algorithm is 


based on the one given in Gaver, Jacobs and Latouche (1984). 


i Stara ewan Av = Bu , compute recursively the 
il 1 
matrices He Ops Wk sa M,-l. 
-> > 
2. Solve the system T Ho = 0, Tye = 15S, 
3. Compure recursively sine lveecremc aie n = 1,2,..-,Mji 


> 
and renormalize the vectors 7's so obtained atvyeacgm 


stage (i.e., renormalize each time a new subvector 
is determined). 
3. The Laplace Transforms 
Following the argument in Gani and Purdue (1984) we 
-_>- 


can obtain an expression for ee US) sf the Laplace transform of 


Pate) 


st 


Multiplying both sides of (2.23) by e ~~ and integrating 


over all values of t, we get the following: 


a, 


> 2 > oe 
To 0 + 71D, = QO 

ae oe CAG SES ip Meese 

Teeo 8 Toco bw oo Bee 
Therefore: 

aT 

Oo) | 


Thus, we have proved the proposition. 


Mmeoosition (2.2) 
The limiting distribution for the bivariate-Birth-and- 
Death process, for the Two Module Logistics model with simul- 


taneous failure is given by the following recursive equations: 


TH. = O 
Mo) = 
TT T (-H 1 | ee <M 
a ea n ) es 
M, " 
) Te eal 
ia 
where: 
H = B 
M, My 
H 6 VB ek Col a yD Oo nes Meal 
n n n+l +] — — “lL 


The claim is that: 


> a > -| 
"hy Tear. ) 
where: 
Pe ee ou) 
n n n n+l° n+l 
H = 8B 
al sor) 
We will prove this by mathematical induction. We know from 


equation (2.26) that the statement is true for n = Mi: 


Suppose it 1s true for n = i. We need to show that the state- 
ment is true for n= i-l. From thewsecond line of (2.2008 
we Gee. 

> - B -> D S 8 

O32 eee ee ean 
Therefore: 

1 7. .B eae ee Se = 

1-22 eee a rn 

-> a =k se 

gee cde ue) oe ae, 

= PO 1 

el ;_9Cy-2'-Hy 1! 
which proves the statement is true for n = i-l. 


1) 


7B VAD eel 

0 ls i 

Bee: 4 CoH 1p - 6 

"9-9 g-o tH, JP) = 
Therefore: 

7 = 6 

loo a 


Thus, we have proved the proposition. 


mmepOosition (2.2) 
ie mbm tingscdistributien for the bivariate-Birth-and- 
Death process, for the Two Module Logistics model with simul- 


taneous failure is given by the following recursive equations: 


TH. = O 
i OuOnn a 
> > -—| 
Ty Nel ees ) 1 Nee My 
aul 
> 
1 ,e =e 
i) 
where: 
H = 8B 
wa seat 
H Se Cen Oem < M-—i 
n n n+l° “n+l _ — lL 


The te laine rs Geka t - 


> ee -| 
ty ee Sa ee 
where: 
H =(sa 4 caer 
n n n n+l° n+l 
H = £8 
Me) 25) 


We will prove this by mathematical induction. We know from 


equation (2.26) that the statement is true for n = M,- 


Suppose it is true for n= 1. We need to show that the state- 
ment is true for n= i-l. From the second line of (2.20), 
we get: 
1 +. 4B +7.D. = 6 
i= = eee | ee 
Therefore: 
> -> > -| = 
eee he ei = So eee 
+ erage | _ oe 
rime Cereal a ie os gy 
> > -| 
cat eae eee 
which proves the statement is true for n = i-l. 


dd 


Meem the third line in (2.20), we get: 


TOuUS*: 


> ae —-| -> - 
T — ae, eee (B ) = 7 2 CG a (-H ) (Ze 26 ) 
M, M, dk My ih M, M, al M, Jl M 


From the second line in (2.25), when n = M,-l, we get: 


> ae > > 
[eo et 2 wD, a eT. AD = Q 
M, Ds My 2 My 1 My 1 M, My 
Simcoe ttuting (2.26), we obtain: 
T C oe B +7 C E65 6 
Aft == 
My Z M,-2 M, i M,-1 M,-1 M.-L M M, 
Therefore: 
1 [B ae: (se ee) =. Cc 
M,-1 M,-1 M,-1 M, My M,-2 M,-2 
> > -l| 
io RIN mc > 4 (Hee, ) 
M, 1 M,-2 My D My Il 
where: 
H = B ae (oh Sp 
M,-1 M,-1 M.-l M, M, 
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Therefore, by knowing le G 


we can use the above proposition to construct the infinitesi- 
mal generator, and hence the Chapman-Kolmogorov equations. 
Now, we are ready to find the limiting distribution for the 
process by adapting the argument from Gaver, Jacobs and 
Latouche (1984). 

1; TReshLini binge D1 sterene1on 


The Markov-process {X) (t) X(t); t > 0} has been 


shown to have a limiting distribution. Let 
— : a 
Tr = lim P_(t) 
n j n 
to 


aS) G 7ye,; Weegee 


Therefore, from (2.23), 26 follows enact. 


ToBo Zn 1,4) = 

> ad > -- 

Te peae tees eee = 0 ie al M,~1 (2.258 
T Co ae = 0 

M) al My il M, M, 


fas 


mem initial condition: 


Po(0) = [1 0 ... 01, PB (0) = 0 l<n<M 


Thus, by comparing the system of equations (2.24) to (2.23), 


we have the following result. 


faeeosition (2.1) 
The Bivariate-Birth-and-Death process {X,(t),X,(t); t > 0} 


for the Two-Module-Logistics model with simultaneous failure 


has infinitesimal generator 


0 0 
a a 
Oo = — ae ae 
~ = ~ 
maar ae a — 
"D 2 Se 
M,-1 M,-1 M,-1 
D B 
My My 
where: 
B = (-(p 466%) + of) ,T if |e pO) a) 
0 Z 2 
= Ga) ee) eT) (ieee (n) _ 
wee CI ( FO  htG) 6 +GU CL) Ut GG UA + OPP A] 1<n< M,-l 
(M._ ) (M, ) (M.) 
= Ak AL dame ke 
mM, = [-(G, +G, ) + G, Aol 
a (n) (a) - 
Cc, = tp F + PyoF “AI O<n<M,-1 
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Baie 
= 


13 


tie cael 


(1) 
t)G, 


Al 


— 
St (OO) pf (0,0) 
95 (0,1) -(£(0,1)+9,(0,1)) p,f(0,1) 
S oe a a “s ~ 
| go (0Mj-1) -(£(0,M)-1)+g, (0,M)-1)) py £(0,M-1) 
g, (1,0) 
g, (1,1) 
+ IP) ft) . a ial : 
~ g, (1M) 
Therefore we get the following set of equations: 
ae en a my 0) ee CO) (0) a (0) zs 
Patt) “= Py (t) | (F +G. )+G, A” +p5F A] + P, | 
= = (n-l1) (n-1) 
Pattee 2 P(t) [p F +py5F A] 
ae (11) ) ei) Tee (ny) 
4 P(t) I-( +G, +G. )+G5 A +poF 
> (n+1) 
af See) <5) 
-> ay (M Jk) (M,-1) 
P _ = ices ee Wl +P15F A] 
ey) (M, ) 
= alk 2 bere 
+ Be eee +G, ) +6. A’ 


| 


(£(n,0)+g, (n,0)) pf (n,0) 


—(£(n,1)+g, (n,1)+g,(n,1))  pjf (nl) 
~ ~ 
~ 
95 (n,M,-1) ~(£(n,M,-1) +9) (n,M,-1) +g. (n,M,-1) ) Bee (n,M,~1) 
95 (n,M,) —(g, (nM) +9, (n,M,)) 
g, (n,0) 
0 
Pret mt) oy (n, 1) 
= 
x 
0 Ds 
g, (n,M,) 
Pray, (0 
Py of (n-1,0) 
p,f (Maley!) Piot Wed oe 
— . 
pf (n-L »M,-1) Py5t (n-l *M,-1) | 
0 | 


ue 


ee | 


From equations 


ik 


(2.21), we can obtain the equations for 


_ PME), (n = 0, -,M,), and expressing these in matrix form 
gives 
Se) (= eee P (t)] 
dt My M, +0 M, /M, 
0 re — ) 
G5 (M, /M,) —(g, (M, -M,) +9, (M, »>M,)) 
got OS) ee (8) Dror ae er pa (t)] 
My IAC M,-1,M, 
p, £(M,-1,0) P} >f (M,-1,0) 
x “af — 
p,f(M,-1,M,-1) Py of (M,-1,M,-1) 
0 
tae Beant 


The forward Chapman-Kolmogorov equations are given by: 


d > = > 
ar Page) “=~ P(t) 
eS = 
mip (t) PB. (t = iis 
By Co 
Pee Sn 
x 0 
\ 
. = re 
a — 
: . 
x ‘ ‘ 
D B 3 
My 1 M,-1 M,-1 
D B 
M, M, 


d _ > > 
any Py (t) = Py (t) Bo + P, (t)D, 
ee (t p P (t)B. +P (t)D 
ee 6 6n ) ee) Se - n n n+l n+l 
i <a M,-1 
= Py (t) = Py Ke oa: Dy (t) By 
1 nk i i ile 


70 


(225 } 


oe 


Let Q be the infinitesimal generator for the Marken 


5 (t); t > O}. Then Q will be a block tri- 


diagonal matrix as follows: 


process {Xj (t),X 


0 0 
D B Ec 
a IL i: 
QO = i = aren @) 
a er pe ame, 
aie 8 a ote — 
0 D Bie e Ce 
M,-1 M,-1 M,-1 
Dy: B 
Ly My 
where Ba! Ca! and Do are square matrices of order Mot+l. The 


diagonal elements of the diagonal matrices By are stricels 
negative and are determined so that the row sums of QO are zero. 
The process can be fully defined by the infinitesimal generaton 
and the initial condition. Therefore, we need to determine 


ali Of thexelenencs.o8 0b oe enc wba 
n n n 
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Let 


=> 
Po (ee =. {PhP Ge) ABE ( 
My M, ,0 M, 71 
Pp (t) = { 
meee? sy a 9S 8) Py 
JL 1 
P(t) = f{ (t (t 
1! ) ae AT MrPy y a 
p = { 
Define the following matrices: 
| fae On 
| f (n,1) 
p {m) _ | 7 
0 1 
0 1 
ey —_ ue .% 
. ‘\ 
N 
0 
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lee 2 
ena, i 
on (t) } 

| 

| 

| 

~ | 
~ | 
£(n,M,-1) | 


system of equations tends to be large as M, and M.~. increase- 


Z 
For example, if there are 50 modules of both types, the system 
has 2,601 equations. Thus, for a large maintenance system, 
the above approach would be infeasible to follow. Therefore, 


another approach is desirable. The Matrix Geometric Method 


of M. Neuts (1981) is the alternative pursued here. 


H. MATRIX GEOMETRIC APPROACH 

Following the approaches in Neuts (1981), and Gani and 
Purdue (1984), we now formulate the continuous time Markov 
process model for the two-module logistics problem. This 
formulation facilitates computations for modules ©&@ Tea mia. 
number. 

Consider {X) (t) ,X, (t); t > 0} as a Markov process om the 


state space Noga es ge Le dektinec below. 


My = { (M, ,G) ’ (M) ,1) peeey (M,,M,)3} 

SM -1 = {(M,-1,0),(4,-1,1),..., (4-1 oe 
aT a GEO) OU Ss er iL) 
So = {(0,0),(0,1),...,(0,M,) } 
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-£(0,0)7),, + g,(1,0)7,, + g5(0,1)1)) = 0 


meen a,0) + g, (1,0))7. 


0 + p,f(i-1,0)7,_ 


iO 


a g,(14+1,0)75 14 6 + g5(i,1)7,,) = 0 


oe (0, 7) ) ie Sly OG) ge Bs Spec d=? i eal 


+ Sq St oe + op el = 0 


£(i-1,j-l)n 


Pio ee ee 


te Sy ae) eee == Go (i, j+l)m, ay = 0 (722 | 


~(g, (1,M,) +. G5 (iM,))1, + Py5f(i-1M -1) 


Ms Vie =i am 


+ p,f(i,M,-1)1, + g, (it1,M,) 1 = 0 


pM foal it+1,M, 


—(g, (M),3) + Jo (M73) Ty, + p, £(M,-1,35) 


17) pote 


+ £(M,-1,j-1)1,, Tet G5 (M,,Jtl)7, ; = 0 


p SS at 
2 1 Ce 


ame 2) 928MM MT Pat Mo) ™ -1,m,-1 7 ° 


Seal og 


) ee. 


i=0 j=0 


Therefore, it is required to solve (M, +1) (M,+1) linear systems 


of equations to compute Vea aoa) oer laeasaze Of the 
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M11) 
at = (g, (M),3) 4 one 1 Cee 
+ p,f(M)-1,3)P,, Se 
a Pyof(M,-1,j-1)P, Siegen 
. Ps cela a Se sics So 
ay My {) 
+ Prat (Myo beMy“ TN) Py oa my-1 ft) 


With initial condteions- 


i if i=j3 = 0 
0 


GEherwilce 


The bivariate continuous-time-Markov process 
(t); t > 0} has already been shown to have a limiting 
distribution. Define 1. ‘ to be the limiting probabi lau we. 


i 


the process being in state (1,}), 1.ée., 


Taking the limit, as t > ~, in the forward Chapmag. 


Kolmogorov equations, gives the following system of equations: 
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Suetracting P. 1 Mo) PEOMmwoOth Sides Vamareaivnrannige iy dt, and 


Meecing dt tend to zero, gives the following: 


dP 4 9 ft) 
a3 = ~£(0,0)P, g(t) + g)(1,0)P, Q(t) + Go(0,1)P, 4 (t) 
ceo o) | 
= ieee (10) + G1 (1,0))P, 9 (t) + pyf(i-1,0)P;_) Q(t) 
age ota M,-1 
dP 9 ae 
’ es be : : . 
at = tO) at Sp NE aCe) + pot (0,3 SE: 
1s Spe td] 3 te) ou 0) al) ee 
Po Ve M,-1 
dP. 5 ft) 
Rite can ay =" (otenel 79). 1 g, (1,)) a GoiirjJ)IP, (tb) 
+ pyfGi-1,5)Py_y 5 (t) + pyof G-1,5-1) Py) 5) () 
“ Pof(i,j-1)P, 5_, ft) + gy tae) U8 age ey 
th Shy et, Dalle 541 ') 
sf 
L < a & M,-1, Ls yj 8 Yoel (F221) 
“a 
aes = —(g, (1,M,) + oN eae 
+ ae Oe Sra veal 
Se Nae ey lina 
+ g, (it1,M,)P5 4 M Gt) ie M,-1 
—— 
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3. “Formullatwonsare 
Under this formulation, it is assumedethat the comdi-= 
tional probability of a simultaneous failure of both Types 
(Py 5) 1S pos jee. {X) (t),X,(t), = > 0} iS ’a@ bivariae. 
birth-ana-death process with parameters given by (2.17). 


Define P (t) to be the conditional probability ae: 


jabtile Jk g 
the process being in state (i,j) given that it started in 
(n,m). Then, 

Cae = tS) alge 
To simplify the notation we suppress the initial condition 


and write, 


To obtain the forward Chapman-Kolmogorov equations, we 
write the probability that the process is in state (i,j) at 
time t+dt as a function of the state probabilities at (ema 


The probability of being in state (i,j) at time ttdt is expresmm 


by: 


Pi g(ttdt) = (1-(£ (i,j) + 9) (i,j) + gy (isj)dtyP, 5 (t) 


+ p, (£(i-1,j5) dtP,_ .(t) + Py5f(i-1,j-1)dt 


es 


(fe). = Pof(i,j-l)dtP; . Ce) 


Sela 1 


ee eal palche (t) 


seo OS) + g5(i,j+l)dtp, 


L aoe 
Ou Gt) 
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Figure 2.3. Transition Flow for the Two-Modules 
Logistics Process Under Formulation II 
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{X, (t),X,(t), t > O} is a bivariate birth-and-death process 
operating on the state space S = {(0,0),.-.,(M) -M,)}. Figure 
(2.3) shows a graphical representation of the rates of transi-— 
tion between states. 


It is clear from the figure (2.3) that state (M, -M,) 


1S a transient soca te. Hence: 


It is also clear that once the state vector departs 
from value (M) M5), the process will never reach (M, -M,) 
again. So unless the process starts in state (M, M5), this 
state will never be visited. Since the initial condition is 
assumed to have all modules up, the supervisor can never ex- 
pect to have all modules of both types down at any point in 
time. This results from the fact that under this formulation 
it iS assumed that when an aircraft is down awaiting modules, 
it is waiting for one module only, never both types. This 
assumption is very Optimistic and it doesn’t represenem 
flight-line logistics operation. Therefore, it was concluded 
that this formulation is inappropriate for the aircraft= 
Squadron logistics problem. 

The preceeding two formulations suggest that a simul- 
taneous failure mechanism (1.e., Pio ° 0) is necessary in 
order to provide operational realism. This is carried out 


Then Mere. Geo. Lon: 
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where: 


4 1 "*e 1 
a = II a ) 
Cy ae eed ais 
J £9) II g, (9) 1 ela 
jee j=) Ja 
-] 
+ + 1 
be 
eee) 
a 
Zee Formulation II 
Under this formulation, it 1S assumed that Pi> = Oy, 


1.e., there 1S no simultaneous failure of both items. Air- 
craft can be reported down either because of a failure of 

Type l, or a Type 2 module, with probabilities Py and Po: 
respectively; where Py as P5 = 1. Therefore the rate parameters 


are given by: 
p, fF (1,3) ; |e eee 
where 
£(i,j) = A min{a,M,-i,M,-j} 


while g, (4,9) and G5 (1,3) are the same as given by equations 


eel 7). 


Define {X, (t) ,X5 (t); t > 0} to be the number of modules of 


i ieew! and Type 2 down at time t, respectively. 
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where: 


si 1 — i 
3 ae i + ) 
Pie) Shee ie eh eon 
I £, (3) I 9, (3) Tl fy (3) 
j=0 j=1 qe 
=j| 
ye Mi - 
*k 
Wh i 5) 
a 


The assumption made under formulation I results 
in a very simple and unrealistic system, because an aircraft 
requires only one type of module to be considered as a mission 
capable aircraft. This formulation iS impractical ase 
aircraft squadron scenarios where the objective of the 
maintenance commander is to maintain the highest possi- 
ble readiness in the squadron. The above formulation could 
be used for modelling a depot repair system where there are 
multiple types of modules that could be assumed to demand 
repair independently. A generalization of the above method 
that can accommodate the depot repair scenario is trivial and 
a closed product form solution for the limiting distripmiewem 
of the joint probability can be found. Suppose there amem 


different types of modules. Then: 


20 


Tee 
1) 


"om 


1M 


lt 1 b- 


M71 M,-1 
g, (n) a £, (n) I 
n=1 n=0 
B 
M,-1 j 
g, (») Tt £, (n) H 
n=1 n=1 
JESS ai Ss M,-1: 
B 
Me 
£, (n) TT g. (n) 
n=L 
B 
M,-1 
g, (n) II £, (n) 
n=0 
B 
M,-1 M, 
g, (n) 1 £, (n) I 
(a0 iota 
B 
5 M,-1 
a) lle (119) TI 
ss n=1 4 n=) 
B 
My 
g, (n) uN g. (n) 
hi 


ore. 


lA 
He 


[A 


A 


(2720) 


. k , k _ 
+ pe Ns 9, + Ae) 25 = 0 


1<j<M-l 


k 
(2.1o% 
ke k 2 
—g, (My) Ty + £,.(M,-1) 1, -1 = 0 

k k 

M. ‘ 

ae, ae 

j=o 7 


where the last expression is the normalizing equation. 

The marginal processes tX, (t), t > 0}, k =e 
can be viewed as independent closed migration processes. 
Hence, the joint distribution is egual to the product of the 
marginals, which are given by (2.19). 

Let Moe be the limiting distribution for cise 


joint process {X, (t) Xo (t); t > Ooi m. 


eZ 
vies = Thee Tl 
1) 1 Jj 
Therefore, we get: 
T - z 
00 M,-1 M.-1 
lion Be) ieee ar) 
n=0 ! n=0 
"03 ~ M-1 ; M.,-1 1 Se 
J i 5 Vi 
I] £, (n) q J, (n) we f. (n) 
n=0 n=l n=)j 


oY 


The forward Chapman-Kolmogorov equations, using the 
same probabilistic argument as in the Single-Module Logistics 


formulation, are given by: 


apy (t) . . 
- SEIS Ge) eee 
k j+1 Be ak 
aP 5 (t) k k 
ar = ~£,. (0) P, (t) + g, (1)P, (t) C218 } 
ap* (t) 
mae k k 
Bete Py ft) + EMT) Py y(t) 
kK Ke 
feeei initial condition: 
1 ite = 
k | 
P. 10) Res 2 
| 0 otherwise 
fo ineeing Distribution for Formulation f 
Let " SeWmeve the Vong run probalvilltty of the Ree 
Beocecss, kK = 1,2, being in state j. Then: 
m = lim PX .(t) Sie 
A t{>c ae) 3) 
ap* (t) 
If the limits exist, then lim a a 0, therefore, 
{00 


the forward Chapman-Kolmogorov equations become: 
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ie forma coma: 

Under this formulation, it 1s assumed that the two 
modules fail independently. The assumption states that an 
aircraft requires only one of the two types to be considered 
a mission capable aircraft. That is, as long as there is one 
module, regardless of its type, installed on the aircraft 
then the aircraft can perform its mission. Suppose that the 


rate parameters are given by: 


£, (5) = Py Aminita,M,-j} ko sat 2 
| WL J = 1,2,...,R,-1 
Wy Ry j = R 7M k = 1,2 


where Sas P> = digs 

Under the above assumption, the marginal processes 
{X, (t), oe O} and CRG); ee 0} are two independent birth 
and death processes. 

Define ee to be the conditional probabilityeen 


h 


the Ke process, k = 1,2, being in state j given that it 


started in state 1. Then 


k _ 
Py (t) = PTX Ce) a ee oS by 2 
Let 
k k 
= Silt 
Bee) ae ) 


ie t+dt PreoObabilwry 
(5) > (i+1,3) p,A min {a,M,-i,M,-jidt 
> (i, +1) pA min{a,M,~-i,M,-j}dt 
-- (14+1,j+1) Py 5A minta,M,-i,M,-j}dt (15) 
> C= ieF5 ) Wy min{R,,i}dt 
~ (1,j-1) U5 min{R,,jidt 
{X, (t) ,X, (t); t > 0} is a finite state space continuous- 


time-Markov process. All states of the process, defined by 
(2.16), communicate, so the Markov process is irreducible. 
Hence, by Theorem (2.1), the limiting distribution exists, 
and’can be found by solving a system of linear equations. The 


parameters of the process are given by: 


mea,)) = A minta,M,-i,M,-j} 


v (oO) 


Jo (i,j) 


Temachievye the Objectives of this chapter, three differ- 
ent formulations for the Two-Modules Logistics problems will 


meepresented. 
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Failure Rate 





Spares Type 2 = 
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Spares Type l 
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FOr Typere 


for Type l 


Capacity Capacity 


Repair Rate 


Repair Rate 


=r Waiting for Waiting for! __ | 
a Type 2-Repair Type-l a 


Repair 
5 (t) = Number of modules x, (t) = Number of modules 
down of Type 2 down of Type l 
Figure 2.2. Schematic of the Two-Modules Logistics System 
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instantaneous cannibalization, so that one aircraft will not 
be awaiting a Type-l module only, while another aircraft 
awaiting a Type-2 module only. A Type-l module can be canni- 
Peeerzed from the latter aircraft and installed on the former 
aircraft resulting in one aircraft operational. 

Finally, it is assumed that repair in both shops is 
Markovian (or exponential) where Wy and HW. denote the repair 
rates at which individual repairs of Type-l and Type-2 
modules, respectively, are completed. Figure (2.2) shows a 
schematic of this system. 

Once X, (t) and X. (t) are known, then the number of modules 
of both types in any category can be determined from the 


Markovian assumptions. 


(1) The number of modules operating is minia,M,-X, (t), 
ex. Ce) s 
ya? 
eri ) The number of spares of Type i is max{0,M,-X, (t)-a}, 
tie). 2 
(1i1) The number of modules in repair at shop i is 
fnmere, X.(t)}, 1 = 1,2 
agate 
(iv) The number of modules of Type i waiting for repair 


icoimax. 0, xX. (t)—-R.}), == lao 
i it 


Thus the number of modules in any category can be determined 
once X.(t), 1 = 1,2, are known. 
The transition probabilities of the process {X, (t),X,(t); 


t > 0}, of order dt are given below: 


2 


result of incorporating the warning time, and considerimaseene 
new parameters for the process. 

Under both classes of the surprise scenarios, we 
were able to compute the readiness of the squadron measured 
in terms of the initial distribution for the number of aixnerarm 


ready to engage in combat. 


G. TWO-MODULES PROBLEM FORMULATION 

Consider an aircraft squadron that consists of a number, 
a, of failure-prone aircraft. Each aircraft requires each of 
two modules (e.g., an engine system, and an avionics system) 
to be considered mission capable. Let Py? Po and P15 be the 
conditional probabilities that, when an aircraft is reported 
down, it requires respectively, Type 1, Type 2, or both types 
of repair, where Py + Py + Py = 1. Let »A denote the overall 
Markovian failure rate of an aircraft. Suppose that there are 
M, and M. modules of Type 1 and Type 2 respectively assigned 
to the organization, where min{M, »M,} >a. Furthermore ier. 
are Ry and Ro repairmen (crews) capable of repairing modules 
of Type 1 and Type 2, respectively, and only one repairman 
(crew) can work on a failed module at any time. 

Let X, (t) and X(t) denote the number of modules of Type 
l and Type 2 that are awaiting or undergoing repair at jeameuee 
Thus the number of mission-capable aircraft is minta,M,~-X, (t), 
M,-X,(t) }. This is the number of aircraft that are failure 


prone; the others are awaiting either a module of Type 1 and/or 


a module of Type 2. This formulation tacitly aseumies 


a 








0576 OS4 ‘OCS 
0624 0556 6257 
0344 G0 7 O142 
0130 Odek5 Vi0s3 
0038 0034 0016 
0008 OO AGO eee 
O001 OO0OL 0001 | 

Therefore, 

- 6 Pe me 
Beane aj 9 — |) PtX(W) = j,X(0) = i|W) 
i) 
which is given by the following table: 
State:j = 0 ilk 2 3 4 5 6 


P{X(W) = j|w} noe? oles Poe .20eeres. 1721 1.1537 .0712 


The readiness probability distribution becomes: 


Number of aircraft:j = 0 I 2 3 4 


PiD(0) = 3} SOc? ni? tee 96.2033. .3970 


Note that the median number of aircraft ready to engage has 
improved to approximately 3; and the expected number of air- 


@raet ready to engage has improved to 2.7325. This is a 
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lees .9404 Oso . 38109 
eo 4 3 Ores a0 8z ~-4192 
Vroo09 Zs . Abeer ~4622 
lnS227 IeZeo2 12m » 922 
Vez692 Veded> - Lege . GAUOF, 
ligeleeiea: 1.3232 .) 16257 9-510 1. 


1.0443 1.2214 1.5002 “Tse 


Hence, 


P{x(W) = 4,x(0) = ilw) P{x(W) = 3|X(0) = i,wiP{x(0) = i} 


iI 
ae, 
= 
= 

re 
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Seace: i. = 0 1 2 2 4 5 6 


ie ) oro Oo Om oso yoo le- § 60953 =.0038 .0005 


Then using equations (2.8), we can compute the 
Squadron readiness probability distribution. This was found 
BO be; 


Mumoer Of Oper- 
merenal aircraft: j 


0 a Z 3 4 


no OMe oom se 0613 0196 


P{D(0) = 3} 


This means that under the total surprise scenario, 
@iemerooability of the squadron having no aircraft ready to 
engage the incoming threat is .3676, the probability of having 
one aircraft operational is .3676, and the probability of having 
two aircraft operational is .1838, etc. Note that the median 
number of aircraft ready to engage is less than 1; and the | 
expected number of aircraft ready to engage is .9387 aircraft 
which is also less than l. This suggests that the squadron 
must prepare for combat in order to survive. 

b. Partial Surprise 


The Laplace transform P. £m was found to 
f 
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fe ~ 103 
MM 0 
P{D(O) = j} = i) ee ei j=a (2.15% 
ka) : 
0 otherwise 


2. An Illustration for the Single-Module Logistics @iigaem 


The following basic data and assumptions were used as 
an example for the Single-Module Logistics model illustration: 


- An aircraft requires one type of module to be considered 
as a mission capable aircraft. 


- The sguadron is assigned a = 4 aircraft. 


- The total number of modules assigned to the squadron 
is M= 6. 


- The maintenance commander is assigned 2 repairmen 


(crews). 
- An aircraft is reported down at a rate of i} = 1 aircraft 
per day, during peacetime, and becomes A' = 0.5 aircraft 


per day, during the warning time, if a partial surprise 
scenario is considered. 


- Modules are repaired at a rate of up = 0.5 modules per 
day during peacetime, and u' = 1 module per day during 
the warning time if a partial surprise scenario is 
considered. 


- The expected time for the warning period (i.e., time 
Until the attack) isis t= someday s- 


For illustration, both classes of surprise attaem 
will be considered. 
a. otal Gunorice 
The limiting distribution for the numeerse 


modules up was found to be: 
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Prom the law of total probability, 


c M Z t 
P{X(W) = j|/W} = ) P{x(W) = j,xX(0) = ilw 
i 
M ~ ~ x 
= ) pix(W) = 3|X(0) = i,wWHP{x(0) = i} 
i= () 
Thus: 
2 M 2 ." 
mea - j|W} = ) 7.P{x(W) = j|X(0) = i,W} (2i3) 
i=0 


Taking the expectation GEeebocne sides or (2.13) 


with respect to W, we obtain the following: 
n | M - re 
pew) = j|Wi] = ) w.EIP{x(W) = j|xX(0) = i,W?] 
i=0 
Using equation (2.11), we get: 
a M a 
Pex (wy) = FIWi) = mn ) wF.Pe 2 (n) (2.14) 


Hence, the readiness probability distribution is 


given by: 
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so that the required readiness is given im terms Of alam 
CeanstOrmn. 
Taking the Laplace transforms of (2.10) and inte- 


grating by parts yields: 


= ' ' = 7 
(uots)P; es) =F: AVP; 7 fs) oe 
= ' ’ ' 
Berea dS 2 + Pe ae co OS 
' = — 
t ery sere OS) = ey oe (2.12% 
LS Veo 
= ' ' = oe 
yt SESS) PU a wed «=? i,m 
where: 
( 1 ii) el 
ee!) = 
ie ) 
0 otherwise 
The readiness probability distribution can be 
calculated by solving ten) 2, x(y) =— j|wWh, j = 0,1,...,a,/eteem 


the above system of linear equations using (2.11) together 
with the initial distribution for the restricted process 


(X(t), & > 0}; Given by M2.) 
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——— = “AwPa ft) + My-aP 3 wed *) 

dp .(t) = iG ee poe Ae) atl P (t) 

eee 1, ) ie lS j— Lae 
341i, ji ©? 

di, er = —-u'P. (t) + ALP. (t) 

aie 1,0 © 16 i aa 


ow 


Let P. a SSH) be the Laplace transform for an 5 t): 


the time of attack, 


a 


~ est > 
tS = e Pee Ce edt 
ee, (5) f ri 


tg > 


(2 Gy) 


To find the readiness probability distribution at 


it 1s required to find the probability 


feeseeroucion for the number of modules available at the time. 


Of attack. Let 


P, 3(W) = P{X(W) = 3]X(0) = i,W} 


Now note that 


EIP. . iy Pe ech) = ' 
[Ps 5 (Ww) h, P; 4 (wine du n by 
Mere Ot = Py = (line 
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(Zag 


~ 


Let X(t) be the number of modules available at 
time t with the new rate parameters. Therefore, the 
{X(t), t > 0} is a continuous-time-Markov process with the 


following rate parameters: 


i =" oA OX ML ee ee 


| Ka er 1 “= sar ,M 
and 
| u'R for 1 = 0,l1,.. ee 
Ws = xX ae Re le 
| u' (M-i) for i = M-R+l,...,M 


The initial condition for {X(t), © > 0) some 


limiting distribution for {X(t), t > 0}, i.e., set Of Ga@uetieme 


aie 
PaO) eee) T sete Pee ner 5 [el (2.99 
Therefore, {X(t), t > 0} is a birth-and-death 
process with initial conditions Ts for i= 0,l,...,M. tee 


(t) = p{x(t) = 3]/xX(0) = i} 


The forward Chapman-Kolmogorov equations for 


eR, te 20) Ga aeel: 
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Let D(0) = Number of interceptors ready to engage in 
combat at the time of attack. 


whryen : 
Ws IONIC) Sa pee Same 
M 
mono) = ji} = ) re os (2.8) 
l=a 
0 otherwise 


This assumes that attacks occur infrequently, so a steady- 
state distribution prevails, and that there is essentially no 
warning. 
b. Partial Surprise 

Suppose that the intelligence data analysis indi- 
cates that the enemy might strike after W units of time (e.g., 
days). Assume that W is a random variable distributed exponen- 
tially with mean ee During such a time period the squadron 
will undergo a mobilization and preparedness stage, and the 
Be dron activities will change. They will eliminate training 
and conduct air reconnaissance and early warning missions 
Only, and they will change (enhance) the maintenance repair 
capability. Such changes are assumed to cause the failure 
rate to decrease and the repair rate to increase. 

Assume that the failure rate decreases from 4 to 
jeeewnere A > X', and that the repair rate increases from u to 


Neemeyinere 1 < pw’. 
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the repair policy implemented, the number and types of test 
and diagnostic equipment, and the supply of spare parts. 
Finally, the quality of facility management is an intangible 
influence. 

The operational factors include the number of aircraft 
assigned to the squadron, the number and skill of the pilots, 
the effectiveness of the training programs, and the sensitivity 
of the early warning system. 

The intelligence factors include: 

(a) The procedures used in collecting information about 
the enemy movements including the prediction of 
enemy actions based on current political status. 

(b) Quality of the analysis of the information collected 
and the confidence of the decision makers in the 
conclusions reached. Information could indicate the 
intention of the enemy, however the defender sometimes 
fall seeeran ered same ms Uieeiet Se malin aCiaam 

The effect of surprise is reduced as the readiness in- 
creases. Surprise attack can be classified in different 
Stages as: (Bredin jlo 7 ©) 


OD) sora surprise, 


(2) Partial surprise, 





(3) No surprise. 
In an attempt to model the surprise phenomena mathematically,. 


the following warning scenario was considered. 


1. Models for Readiness: Stages of Surprise 
a. Total Surprise 


Under the Single-Module-Logistics formulation, if 
a total surprise phenomenon is considered, then a readiness 


distribution model can be derived as follows: 


Al 








oe 2 ee 
fl ou 
Oe 
Tt = 2 oe Set ae 
a a M-1 ag (2.7) 
Tec: * ee 
j=l J jai J 
_ B 
"™ 7 OM 
TI A 
alee 
where: 
-1 
M-1 
a 1 l alt 
on a M-1 = 4 af M-1 + i 
leer (lle T A. Nie I] A 
j=0 J j=l J jai J j=1 J 
Readiness: 


The factors affecting the combat readiness of an inter- 
Septor squadron can be categorized as: 
- Factors that are related to the logistics system. 
- Factors that are related to the operational system. 


fmeecde tors that are related to the intelligence Or warning 
system. 


The logistical factors include the number of spare modules 
authorized to keep on base, the number of maintenance per- 
sonnel assigned to the maintenance organization, the skill 


and level of training of maintenance personnel, together with 
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M-R- l i 
ter a © LBL a y Rt) ee 
0 ae i! x 0 eo (Rie) lato 1M = R=) ee 
Tass 
M=R-1 1 M i =a 
7 1 ,Ru R! Wl Ie— IL il u 
Da i ae (ae) ) > (=) } 
0 Aes ie ! = _p iM 1) ) ee 
(2 oe 


Therefore, the limiting distribution can be calculaeeamas 


determining 1, first using equation (2.6), and then apo aa 


0 
equation (2.5) to calculate the limiting ™prebabiliea- 


recursively. 


Approach 2; 

Another approach to computing the ™'s is to view the 
system as a closed migration process. Kelly (1974) shows 
that a closed product form can be derived for the equilibrium 
distribution. 

The flight line and the repair shop can be considered as 
stations between which the modules move. Assume that modules 
cannot leave or enter the system, and that the total number 
of modules in the system, M, is fixed. Then, X(t) is a cyclié 
queue, where a module departing from one station joins the 
obher with probatjadlic aa. 

Using Kelly's results for a closed migration process, we 


get the following expressions for the limiting distribution: 


Sy) 


—-(A\.+u.)7. + Ts aa 
ae soak eye 


ee ae 


0 


b= 4) 


Below are given alternative methods for calculating T.. 


Pepsoach |: 


The finite-state-continuous-time Markov process 


meee, t > O} has been shown to have a limiting distribution. 


From the set of equations (2.4), T. 


Sively as: 





can be written recur- 


( 5x Ts oy ene LL 
TMT — 
eT 
wed) Tey for 1 = M-R, 
Therefore: 
1 
Je IRS 
craw aml 
Lee NIG 
1 ae 
CEEORETECY I=(M-R-I) 
M 
oie) T, = 1 Hence 
i) 
M-R-L M 
T 9 ae ) T. + ) TT =). 


BO mie le. . 


(25) 


eA). 


fOr id =M=R,...,7M 


F.> LIMPTING Bist Rie rr 


All states of the Markov process defined by (2.1) communi 


cate so the Markov process is irreducible. Hence the limita 


distribution exists and is independent of the initial condition. 


Since every state is a positive recurrent state, the limiting 


values are all positive and form a probability distribution. 


This results from the following theorem (Bhat, 1984): 


(i) 


(2) 


Theorem (2.1) 


If the Markov process is irreducible then the limiting 
distribution lam Pee). — Te exists and is independent 
> 00 


1e 
of the initial conditions of the process. The limits 


im, j « S}, where S is the state space, are such that 


they either vanish identically (1.e., tT. = 0 for all 

j € S) or are all positive and form a probability 

distribution (i.e., 1, > 0 for all j ¢ S, } “_iwom 
J j¢S J 


The limiting distribution Uc j e€ S} of an irreducible 
positive recurrent Markov process is given by the unique 
solution of the equation 7Q = 0, and es 1. = 1, Witeme 
OQ is the infinitesimal generator for oe process, and 


iS ee 
‘ee (To rTyreee)- 


Let t. denote the long-run probability of the process 


being in state j. Therefore: 
Tr = lim P. (t) 
J t>o 


d 


From the above, as t + ~, aE P.(t) + 0, therefore the 


J 


forward Chapman-Kolmogorov equations (2.2) become: 


ow) 


Subtracting Bg ne from both sides and dividing by dt and 


Meeting dt tend to zero results in the following: 


gre tt) 


ta = (A. t+u4) P(t) - Ma _yPa_y (t) ae 


J J of 


j+1* 541 





since ae —Oeccmiite- O. (With the #nitial condition: 


| 1 if j =M 


otherwise 


the forward Chapman-Kolmogorov equations are: 


dP, (t) 
Meee OP ft) + Uy Peg SP) 
dP, (t) 
AE “UpPy (t) ee ee, 
dP (t) 
He = “OA; tu) P(t) + H4_yP5_4 (t) + pode el 


wemei the initial condition: 


( ig) c= UM 
PEO} = 


J 
| 0 otherwise 
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(2.2) 


(i+ ty) 
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Meqee space {i = 0,1,2,...,M}. The parameters of the process 


are given by: 


rs “—emex<minia,i} = 
| ra for l=a, 7M 
and 
( uR por sije—e 0), ),2,+..,M=R 
Us Se xmin{R,M-1} = 


| u x (M-i) for 1 = M-Rtl,...,M 


Let Q be the infinitesimal generator for the Markov process 
{X(t), t > O}. Then Q will be given by the matrix on the next 
page. Define Egg ME) to be the conditional probability of the 
process being in state j given that it started in state 1. 

Then Pig ft) = P{X(t) SO) — 1 los Oty tie notation 


we suppress the initial conditions and write, 


The forward Chapman-Kolmogorov equations are derived by 
writing the probability that the process is in state j at 
tame d+dt as a function of the state probabilities at time 
Peeeethne probability of being in state j at time t+dt is 


expressed by: 


Py nee = ec ee ke) 3 ie es pe 4. AG (ONE Sig Mee ae (eles) 
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"spares" 
Capacity = a air- 
craft 
Failure rate 
X(t) = Number of available modules 







Repair Shop 


Walle dmG@ee ro te 






Repair Capacity 
| | Repair Rate 
—$——— > eee 


Number of modules "down" 


Figure 2.1. Schematic of the Siig leVeduec 
Logistics System 


ye 


is assumed that repair is Markovian (or exponential), where uy 
denotes the rate at which an individual repair is completed. 
Figure (2.1) shows a schematic of the above system. Karlin 
and Taylor (1984) have analyzed the above problem and have 
Shown that once X(t) is known, the number of modules in any 


category can be determined. A module can be in any of four 


States: 
(ei) Operating (installed on aircraft). 
fei) Jee DuUE NOL Goerating, 1 .c..,.a spare. 


(i111) Under repair. 
fy ) Waiting for repair. 


Fach of the modules down at time t must either be undergoing 


Or awaiting repair. Thus: 
(i) The number of modules operating is min{a,X(t)}. 
ii) The number of spares is max{0,X(t)-al. 


erry The number of modules in repair is min{R,M-X(t)}. 
(iv) The number waiting for repair is max{0,M-X(t)-R}. 
The number of modules in any category can therefore be 
determined easily once X(t) is known. 
The transition probabilities of the process {X(t), t > 0}, 


of order dt are given below: 





& ieee Probabali ey 
ft = fie u min{R,M-i} 
ee i-l A faa aes) 5 oy (Dil) 


The above assumptions and formulation specify the stochas- 


miemirecess {X(t), £ > 0} as a birth-and-death process with 
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may experience either simultaneous or independent demands for 
two types of repair, depending on the case under consideration. 
Let the number of modules of type 1, 12=1,2 for repair at time 
te lee {X,(t), t > 0, i= 1,2}. Then the bivariate vector having 
components X, (t) and Xo, (t) can be considered to be the state 

of the system at time t. If full cannibalization isWatt. 
then X, (t) and X5 (t) determine the number of aircraft operational 
As is true for the univariate case, this process may be modelled 
as a bivariate-continuous-time Markov process. More generally, 
if we have a multi-module, e.g., K-module, setup, the process 
could be modelled by a Ko) _yariate-continuous-time Markovian 


process. 


E. SINGLE-MODULE PROBLEM FORMULATION 

Consider an aircraft squadron that consists of a number, a, 
of failure-prone aircraft. Each will be considered not mission 
capable if, and only if, a specific module is not working. Let 
X denote the overall Markovian failure rate of an aircraft, 
where failure of an aioe means a failure of the module it 
currently carries. Suppose that there are M modules assigned 
to the organization where M > a, and there are Rk mepaiaem 
capable of repairing the modules, and only one repairman 1S 
reguired to repair a failed module. 

Let X(t) denote the number of modules that are installed 
or available at time t. Thus the number of mission capable 
aircraft is minita,X(t)}, which is the number of alrcrvan weenie 


are failure-prone, the others awaiting a module. Finally, it 


eu 


fae COPE 

An air interceptor squadron is selected to represent the 
WGmeestical situation under study. The squadron is considered 
to be assigned a number, a, of aircraft. The study concen- 
trates on finding the readiness of the aircraft at the time 
of attack by enemy bombers. This readiness depends upon the 
total number of each module type and the number and rates of 
mea Chavacteristicyof the repairmen in each shop. In turn, 


eae readiness that results influences combat effectiveness. 


D. APPROACH 

To achieve the above objective, the logistics system of the 
Squadron during a "peacetime" (noncombat) situation must be 
analyzed. The repair shop experiences demands for repair, 
depending on the type of problem under study. If the problem 
formulation considered assumes that the whole aircraft is a module, 
then the shop experiences a Single type of demand for repair. 

Let the number of modules up at time t be {X(t), t > 0}; 
under Markov conditions the variable X(t) can be considered to 
be the state of the system. Because of the random nature of 
the system state change, the process {X(t); t > 0} represents 
a stochastic process. By introducing certain reasonable assump- 
tions that will be stated later, the process can be modelled as 
a continuous-time Markov process. 

However, if the problem under study assumes that an aircraft 
requires each of two types of modules to qualify as a mission 


Capable aircraft, then the two-shop maintenance organization 
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gave a good approximation to long-run aircraft availability 
when compared with simulation model results. Their work tends 
to validate the use of a convenient approximate model (diffu- 
Sion) for decision making. 

The single-type module repairman problem is presented first 
in this chapter followed by the two-type module repairman prob- 
lem. After discussing the objectives of this chapter, the 
models for the various types of problems will then be constructed 
followed by sample solutions. The probability distribution 
function for the interceptor squadron readiness will be calcu- 
lated. Those results will then be used in Chapter V for the 


blending of the logistics and combat models. 


Bye ObekCl Lye 
The objective of this chapter is to formulate and analyze 
the generalized repairman problem for the maintenance organi- 
zation of an interceptor squadron. Analysis of the repairman 
problem means determining the various factors affecting the 
repair process in the organization. A major factor is the 
number of different types of modules requiring different types 
of repair facilities and different repair times. This chapter 
analyzes the following repairman problems: 
- a single type of module. 
- two types of modules with independent failure rates. 
- two types of modules with dependent failure rates, with 
the probability of a simultaneous failure of both modules 
being negligible. 


- two types of modules with a non-zero simultaneous 
failure rate. 


ES 


needs to be determined. The repair policy represented by 


the vector y recommends that: whenever the system is in 
State n take the decision y(n), (e.g., if in state 1 then 
mie Cecision 1, if in state 5 take decision 3, etc.). Now, 


to determine the corresponding infinitesimal generator Q, 


we use the following algorithm: 


moms n= il, (M, +1) (M,+1) 


(n,m) m= 1,...,(M)+1) (M541). 


The preceding discussion for determining Q will be clearer 
when the infinitesimal generator Q* for the optimal policy 
is determined. 

Note that the policy decision is made potentially at 
Pea) state change. 

In an attempt to search for the most favorable (1.e., 
Optimal) policy that needs to be followed in order to maxi- 
mize the readiness of the squadron we maximize the expected 
mamoer Of aircraft ready to engage in combat. Table 3.2 
shows the total number of aircraft ready to engage (f(n)) 


meee tne yarious states of the process. 
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TABLE e3re2 


NUMBER OF AIRCRAFT OPERATIONAL WHEN 
THE PROCESS PS ei om ene olen) 


state: Seabee: No. of Aircraft 
n lal f (n) 
1 (0,0) 2 
2 (O71) 2 
3 (0,2) 1 
4 (0,3) 0 
5 (0) 1 
6 ly.) l 
y l2) iL 
8 cs) 0 
S (2730) 0 
10 (215) 0 
il (252) 0 
WZ (233) 0 


K. RESULTS AND ANALYSIS 
1. Steady State Analysis 
For any policy the long-run expected number of air- 
craft that are up and ready to engage per unit time, E[D(-)], 
can be calculated by multiplying the number of aircraft up 
when in state n (f(n)) by the long-run (limiting) probabiieaa, 


of being in state n (m7) and summing over all possible states. 
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(M, +1) (M,+1) 


E{D(~)] = ) £(n)7_, (Y) VY 
n 
n=l 
Ie 
aD (o)\ = ) Eee ) ee 
n 
n=1 
miner eC ; 

im, (y¥)+---,7,5(y¥)} represents the steady-state 
distribution of the state of 
the system under the policy 
being evaluated. 

The state space consists of only 12 states. 
Since all states communicate, the process is a 
regular Markov process. Therefore the limiting probabili- 


ties exist. The resulting optimal policy is dependent on 
mie snumber Of aircraft, modules of Type 1, modules of Type 
2, and repairmen assigned to the base. 
2. Optimization Results 
a. Linear Programming Results 

The results of applying the linear programming 
optimization approach using the LINDO package are shown 
below in Table 3.3. The resulting optimal policy is shown 
immediately following Table 3.3. 

This optimal policy recommends assigning no 
repairmen to Shop 1 when there are no items of Type 1 down, 


assigning one repairman to Shop 1 when there is an item of 


Type 1 down, and assigning two repairmen to Shop 1 when there 
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TABLES 3 


LINEAR PROGRAMMING RESULTS 





T, (1) =) VEies 
Ty (2) = =F 0996 
Ty) (3) = «0511 
T) (4) = .0105 
7, (9) = .2739 
T5(6) = .1536 
7, (7) = .0454 
7, (8) = 30120 
T(9) = .1629 
Ty(10) = .0534 
tT, (11) = OMT 
1, (12) = .0022 
a 2 3 4 S 6 i 8 9 10 10h 12 
State (0,0) (0,1) (0,2) (0,3) (1,0) (1,1) (172) (173) (270)" (27a eee 
Decision 0 0 0 0 3 2 i 1 3 2 2 2 


are two items of Type 1 down. The remaining number of 
repairmen are to be assigned to Shop 2 if there are items of 
Type 2 down or they are idle. Following this policy gives 

an objective function value (lien, peered iinbe ane nn wea 
craft that are operational) of .9579. This policy determines 
a unique bivariate-continuous-time Markov process with the 


following infinitesimal generator: 
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Therefore, by assigning the repairmen accordime 
to the optimal policy, the resulting stochastic process 
can be assumed to be a bivariate-continuous-time-Markov 
5 Ee 0}, over the state space 
S = ((0,0),(0,1) , (0,2)... (273 ween ee eee eee ce 


proces 1iX, (t),X 


generator 0” andy interal condaetoma. 


| al te oe 0) yh SS 0 


Such a process has the limiting probabilities 
Shown in Table 3.3 and an expected number of aircraft ready 
to engage of .9579. 

b. Dynamic Programming Results 

The results of applying the dynamic programming 
procedure are given in Table 3.4. The optimal policy is 
shown immediately following Table 3.4. The total objective 
Function value = 4 75772 

The infinitesimal generator (Q*) for the 
continuous-time Markov process resulting from the application 


Of the optimal volicy as: 


Bhs 9 


TABLE 3.4 


DYNAMIC PROGRAMMING RESULTS 


m,(1) = .1180 
T5(2) = .0990 
Tm, (3) = .0511 
Ty (4) = .0105 
Ta(5) = .2739 
(6) = «Lo S6 
1, (7) = .0454 
mT, (8) = .0120 
1 (9) = .1629 
1, (10) = .0534 
m, (11) =) 2.079 
1, (12) = .0023 
The optimal policy is: 
i Z 3 4 5 6 t 8 9 10 ala 12 
State: imeem Orda) 2) eng bere) my mle) cle m3) (2,0) (2,1) (2,2) (2,3) 
Decision: 3 Zz 1 0 5 2 a 1 3 2 2 2 
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Suppose the squadron is assigned 6 aircraft, 


fee— 6 modules of Type 1, and M. = 7 modules of Type 2. 


i 2 
The repair shop supervisor is assigned 6 repairmen, while 
the remaining parameters are the same as in the previous 
example. Table (3.5) gives a summary of the results. 
It shows for every state 'n', the corresponding (i,j) state 
for the bivariate process, the recommended number of repair- 
men to be assigned to Shop 1, and the number of aircraft 
that are up and ready to engage whenever the process is found 
memee in state (1,3). Following this policy the squadron 
will maintain on the average 2.88 aircraft up at any time. 
L. COMPARISON OF THE DYNAMIC PROGRAMMING AND THE LINEAR 
PROGRAMMING SOLUTIONS 
A comparison of the dynamic programming and the linear 
programming approaches shows that the two approaches yield 
different policies. Table 3.6 shows the results Side by side. 


Both approaches gave the same limiting distribution and 


hence the same objective value. The difference in the opti- 
mal policies when ee = 0} suggests that there is more 
meme one Optimal policy, i.e., the optimal policy is not unique. 


foes 1S intuitively obvious since there is no cost asso- 
ciated with moving repairmen between shops, the assignment 
of idle repairmen to Shop 1 versus Shop 2 doesn't affect 
the objective function value. 

Both approaches resulted in the same infinitesimal 


generator Q*, and since both processes have the same initial 
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TABLE See5 


A SUMMARY OF THE PESUL?S OBVAINED BY DYNAMIC 
PROGRAMMING RUN FOR THE 6 AIPCRAFT CASE 


r (Led) DECISION AIRCRAFT Ww? 
SSSSSSSSSSSSESSSSE§SSSSSESSESESESSSSSISGSSGees see SUsesssesse 

1 (0.0) 6. 6. 

2 (O01) =. 6. 

3 (002) é. 3. 

‘ (0.3? S$. ‘. 

3 (806) 2. $. 

$ (0.5) is 2: 

? (8-6) @. 1. 

@ (007) a. a. 

9 (3.0) t. $. 
19 (361) S. $. 
13 (1.2) 4. $. 
12 (3.3) 3. 45 
13 (304) zc i 
14 (1.5) Ve 2. 
1$ (1.6) @. be . 
16 (1.2) a. @. 
1? (2.9) 6. «: 
18 (201) S. é. 
19 (2.2) ‘6. 6. 
20 (2.3) 3. ‘. 
23 (2.4) Ze 3. 
22 (2.8) ie z. 
23 (206) @. 1; 
24 (2.7) 0. 6. 
23 (3.0) e i: 

2 (3.1) 5. 36 
27 (3.2) é. 3. 
28 (3.3) <- 3. 
29 (3.6) x5 3. 
38 (3.8) 3. 6 
31 (3.6) 3. Ne 
32 (3.7) 0. 0. 
33 (6.0) 6. Z 
36 (601) $. Zs 
3S (6.22 6. 2: 
$6 (6.3) 4. ae, 
37 (6.6) ‘. 2: 
38 (6.8) 6. 2: 
39 (6.6) @. ie 
4a (4.7) 8. Q. 
«3 ($.0) 6. 2. 
42 ($62) 5. Ne 
43 ($e2) $. 1. 
64 ($.3) S. Ie 
43 ($04) $. Pe 
<6 ($65) S. Pe : 
6? ($6) S. i ie 
ss ($.7) a. a. 
“9 (6.9) ‘é: 0. 
30 (601) 6. Go. 
$2 (6.2) . a. 
$2 (6.3) 6. a. 
$3 (6.6) ‘. anise 
$6 (6.5) é. ce: 
$5 (6.46) 6. a. 
$6 (6.7) 6. a. 
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TABLE 3.6 


Pho S sor BOTH OPTIMIZATION APPROACHES SIDE BY SIDE 


State Decision: Beers lon. 
D=P Lye 
(G7 oF 3 0 
Coy) 2 0 
uC? 2) il 0 
(O32) 0 0 
(JER) 3 3 
ea) 2 Z 
(Gera iL 1 
(Gle55o)) il IL 
(270) 5 ) 
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distribution, therefore, it may be concluded that both 
approaches identified the same bivariate-continuous-time 
Markov process. 

Observe that whenever the process is ina state 
meg) such that i+j < R, the optimal decision will always 
PewtO assign i repairmen to Shop 1 and j repairmen to Shop 2 
and any idle repairmen to either shop. However, if 1i+j > R, 
then a decision has to be made to determine the number of 


repairmen to be assigned to Shop l. 


iby] 


Consider the state 42,2). The Optimal, pela, 
calls for assigning 2 repairmen to Shop 1, and a single 
repairman to Shop 2. This shows that the supervisor is giving 
a priority to items of Type 1 since both aircraft are dew 
and only one item of Type 1 is needed to get one aircraft 
Byer 

Consider the state (2,3). The optimal policy 
still calls for the assignment of 2 repairmen to Shop 1, and 
a single repairman to Shop 2. This shows that the supervisor 
must still give priority to items of Type 1, even though an 
aircraft requires both items to be in up condition. ilies 
1s due to the difference in the repair rates, HW, = .5 ane 
ey 1 module per day. Therefore, it takes two days on the 


average to repair a module of Type 1 and one day to repair 


a module of Type 2. To carry out the analysis mathematically, 
define: 
; Ps) Ol ere 
Ul; = Time to repair the 1 item of Type ae 
1 Sel ee 
U, = Time required to repair the first item of 
Type l. 
U, = min{U,,,U,} 
Therefore, Ula. 1 = 1,2 are two independent identically 


distributed exponential random variables with rate Uy 


Hence: 
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See ere > ty 
_ aga a 7 Rees 
Thus: U, = min{U,,,U,5} is an exponential random variable 
with rate 2u,- In the example, HW, = .5. Therefore the rate 


Ee get the first item of Type 1, when the process is in 
state (2,3) with 2 repairmen assigned to Shop 1, is l. 
Therefore, on the average, when in state (2,3) (i.e., all 
modules are down and 2 modules are needed, one of each type, 
to get an aircraft up), it takes on the average one day to 
get the first aircraft operational. If the supervisor has 
assigned only one repairman to Shop.1 and 2 to Shop 2, then 
it will take on the average 2 days to get a module of Type 1 
up. By following the above analysis for Type 2 modules, it 
will take on the average 1/2 day to get the first module. 
However, an aircraft requires both types to be considered 
up. Therefore on the average it will take 2 days to get the 
first aircraft up. The preceding analysis supports the deci- 
Sion provided by the optimal policy. 

As shown earlier, the decisions to be taken 
whenever the process is in a state (i,j) such that i+j < R 


(R= 3) is trivial. To determine if the resulting repair 


Ese, 


policy is indeed optimal, a Fortran program was written 
to evaluate all possible policies. This is done by 
considering all possible decisions that could be taken 
whenever the process is found in state: (lyse, (2eezee 
or (2,3). Table (3.7) shows all possible policies, the corres- 
ponding limiting probabilities of the resulting process and 
the objective function value. It is clear that the repair 
policy suggested by both the linear programming and the 
dynamic programming approaches are optimal policies, resulting 
in the same Markov process. 
The linear programming approach has the advantage 
of the widespread availability of commercial packages for 
use (e.g., LINDO and MPS III). An additional advantage of 
the linear programming approach is the ability to easily 
conduct sensitivity analyses. However, for large numbers of 
modules, aircraft and repairmen, the linear programming approach 
may be impractical. It arene that the dynamic programming 
approach is more suitable for the larger size problems because: 
- It requires less data input and preparation. 
- There might be a possibility of degenerate solutions in 
linear programming which will yield an impractical 


optimal solution (é@.g., in the case when there wae. 
round-off errors in calculating the rates such that 


(M) +1) (M41) 
L q,, (1,9) 
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doesn't equal 1 exactly). 
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IV. FORMULATION AND ANALYSIS OF SOME COMBAT MODELS 


A.  ANTPROSUECELOH 

In order to formulate Combat-Logistics models, consider- 
ation of some relevant combat situations are necessary. THeeS 
chapter presents an analysis of an air defense scenario for 
a relatively small country, or, alternatively, an area (or 
sector) of responsibility to a defense system. The air defense 


system is assumed to consist of: 


1. An interceptor squadron made up of a relatively small 
number of aircraft equipped to engage in air-to-air 
combat. 


2. A Surface-to-Air system that consists of a number of 
Surface-to~-Air Missile (SAM) batteries, and Anti- 
Aircraft-Artillary (AAA) batteries. 

3. An early warning system that has a long range radar, 
and uses information from an airborne warning and control 
system (AWACS) operated by friendly forces. 

4. <A command, control and communication (C3) system. 

The air defense system is responsible for defending against 
any hostile air attack from a hostile agent, e.g., nation. 
Suppose that the objective of the air defense system is to 
absorb the initial strike; after the initial campaign it is 
assumed that there will be some support from other friendly 
agents. The term "absorb" means to cause maximum possible 
reduction of the hostile damage to the area being defended. 


Consider the following threat scenario that the air defense 


system might encounter. A hostile attack occurs 


Io2 


unexpectedly with multiple bombers; the attack objective is 


to destroy some high-valued military and/or national targets. 
The bombers appear in a wave, i.e., essentially simultaneously. 

It is assumed that the air defense doctrine dictates that 
for any incoming threat, the air interceptor squadron will 
First engage the threat until the threat reaches a certain 
imaginary line (set by doctrine); surviving bombers that cross 
the line are attacked by the SAM units. The imaginary line 
will be referred to as the hand-over line, and the term "threat" 
means the enemy bombers. Therefore, the time required by the 
threat to reach the hand-over line from time of detection 
determines the time that is possible for the air interceptors 
to engage the threat. At a later time (or shorter range) the 
SAM units will engage until the threat reaches yet another 
hand-over line, at which point the AAA system will take over 
to engage the surviving threat elements. At each line the 
leakage from the stage before must be dealt with by the system 
in guestion. Figure (4.1) illustrates the above scenario. 

Notice that each stage constitutes a different type of 
SBembat; the leakage from that stage provides the input for the 
stage following. For example, the leakage of the air-to-air 
combat process is the input to the SAM-to-bombers engagement 
process (e.g., the number of bombers to be engaged by SAM). 

A feasible enemy doctrine dictates that the mission of 
the bombers is to be aborted as soon as the number of bombers 


Surviving the combat drops below a certain number. 
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This study presents various models for the air-to-air 
combat process; these models will facilitate the linking of 
the operational logistics models presented in the previous 
chapters to produce the desired combat-logistics models. The 
combat-logistics models allow the decision maker to explicitly 
relate combat outcomes to logistics system scale and organization. 
Some of the 2a iLuEUAE measures-of-effectiveness (MOE's) for 
the air-interceptor squadron are the following: 


1. The expected number of bombers reaching the first hand- 
over line; this measure is to be minimized. This step 
minimizes the expected number of bombers that will be 
engaged by the SAM units. 


feeeiine probability that exactly z (z < B(0)), or no more 
than z, bombers leak through stage 1. Particular inter- 
est may well be in z= 0. The above measure is more 
general than the first-mentioned measure, but is also 
Moet teule LO compute. “Diffusion approximations 
evaluate this measure in terms of the mean and variance 
of the leakage at hand-over time. 


Bee The duration of the air-to-air combat. Extending the 
combat duration will delay the bombers from reaching 
jmme first hand-over line. In turn, this will result 
in the bombers burning more fuel, which might result 
iieeemoers aborting their mission. This MOE in 
turn will also allow the SAM units longer warning 
time to prepare for combat. The manner in which 
ee -Lo-ait Combat Guration Gan be increased is by 
the range of first detection; which is a factor we 
study in the next chapter. 


The general measure of the effectiveness of the 
air-interceptor squadron that will be considered (modelled 
and optimized) in this study is to minimize the probability 
mampemnetration of the enemy bombers. Here the term “penetra~ 
tion" refers to the ability of the enemy bombers to reach an 


imaginary line (hand-over line) beyond which lies an important 


1kG'S 


defense asset (e.g., SAM units), Or beyond whieh the wehrete 
will release its load (i.e., bomb-release line). 
Air-interceptor squadrons usually fight with a homogeneous 

set of aircraft. The squadron should be equipped so that it 
is capable of defeating an anticipated threat force. The 
Opposing force structure at the beginning of a combat period 
(t = 0) is Bei serene mathematically by the vector (B(0),D(0)), 
where: 

B(Q) = The number of enemy Bombers at the beg iiaian 

of the combat period. 
D(O) = The number of Defending aircraft at the 
beginning of the combat period. 

Here the term "combat period" refers to the period during which 
the defenders and attackers (bombers) will meet in combat. It 
effectively begins when the bombers are in the range of the 
defenders. The duration of the combat period can be Vengenenwes 
by extending the warning range. The study assumes that this 
duration is deterministic. It could be provided by the decision 
maker (e.g., points in time at which the decision maker is 
interested in knowing the opposing force distribution), or 
could be the time for the bombers to fly from point of detection/ 


intercept to hand-over line. 


B. PROBLEM CHARAGTERISTVEes 
The study considers two features of the combat situation: 


the early warning process, and the air-to-air combat process. 


Jeans 


Pe ine Barly; Warning Process 
The early warning process consists of the following 
operations. 
a. Radar Detection of a Hostile Attack 
Radar locates an aerial target in azimuth, range 
and altitude. It then estimates the target course, speed and 
strength (number of attacking bombers). The radar character- 
istics (particularly range) depend primarily upon the type 
and performance of the radar used, as well as the altitude 
selected for the antenna. 
pee lkarget Identification 
Identification enables targets to be classified 
in various categories (e.g., friendly, hostile, or unidenti- 
mea). SO a secondary radar which is identification--friendly 
or foe (IFF)--has to be used. 
cmelineat Evaluation 
This phase evaluates a threat index, which depends 
upon: 
Sethe Size of the attacking force. 
- Geographical location. 


= The required flight time to the high valued ground 
targets or installations. 


dad. Transmission of the Warning 
Warning is transmitted to all air defense units 
(for example, interceptor squadron, SAM batteries, and the 
AAA units) and also to the areas being defended and even the 


Civil population (shelters). 


io? 


Successful execution of the above operations or 
missions is affected by factors such as: 
- Radar range; the reliability and maintainability of 
the equipment, including adequacy of spare parts and 
maintenance facility, and equipment calibration. 
- Training, skill, motivation, vigilance o£ the operagen-- 


- Operational doctrine of the early warning system. 


- The availability of, and coordination with, supplementary 
detection system. 


Such supplementary systems include other friendly 
early warning systems in the area, as well as possible infor- 
mation from neighboring allied countries. 

The objective of the early warning system assumed 
for this study is to maximize the time available for combat, 
by detecting the enemy threat far enough in advance to launch 
the air-interceptor squadron, so as to engage the incoming 
threat the longest possible time before reaching their bomb- 
release line. It is assumed that the longer is the available 
time for engagement (combat), the greater is the likely reduc- 
tion in Che anceming Ehseart. 

2. The Air=-to=-Aiz Combac, Proce. 

After detection of the incoming threat, and identified 
as hostile targets, the engagement of targets by the air- 
interceptor squadron requires the following steps. 

a. Scrambling All Operate eA reece 

The scramble time is measured from announcement of 


the alert to the pilots until take-off. This time consists 
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Of the time needed to start the aircraft engines, the time 
Bequired to align the instruments, and the taxiing time. 
b. Target Designation and Engagement 
This step consists of assigning an enemy bomber, 
Sempeecea according to its threat index, to the aircraft most 
suited to achieve target interception and destruction. The 
outcome of the engagement is highly dependent on factors such 
as: 
- Defender: Acceleration capability and tolerance, condi- 
tional kill probabilities given a hit, bomber silhouette 
dimensions, and the statistical nature of the projectile 
(missiles and/or guns) versus target range. Skill and 
training of the pilots also has an influence on the 
outcome of the engagement, together with the rate of 
fire that can be achieved by the weapon system. 
= Bomber: Availability and usage of electronic counter- 
measure, accuracy of its defensive air-to-air weapon 
system, the amount of load carried, skill and motivation 
of pilots, and familiarity of pilots with defender's 
EACEILCS . 
- The reliability and effectiveness of the command and 
control system, and the skill and training of the ground 
SOCrLaALOLS. 
C. MODELLING APPROACH 

The complex problem of describing the interaction among 
the different variables, resulting from considering all of 
the preceding combat factors in detail, makes the use of a 
high-resolution combat simulation appear necessary for repre- 
senting the combat process in detail, i.e., at a "micro" 


level. In this chapter we will represent the combat process 


alternatively and at a simple "macro" level by: 


IGS, 


1. Deterministic (differential equations) models. 
2. Diffusion processes. 
3. Continuous-time-discrete-state Markov process. 

Such representations, as will be seen, allow useful 
calculations to be made analytically. The models do not, 
however, recognize all detailed constraints to which the com- 
bat process is subject. Nevertheless, they, or their exten- 
sions, provide useful guidance to a decision maker. 

The viewpoint taken to obtain macro-level combat models 
1s familiar, see Taylor (1983). At any point Gf Cimewdiee 
the combat process, a defender aircraft can be found to be 
either (1) engaging an enemy bomber, (ii) free and looking 
for a free bomber, or (111i) killed. Similarly, an enemy 
bomber can be found to be either engaged by a defender aircraft 
or free and trying to avoid being detected or found by defender 
aircraft, or killed. Suppose that we assume fight to the 
finish; that is, once a defender aircraft detects and engages 
an enemy bomber, the one-to-one engagement process wile eae 
tinue until either the bomber is killed or the defender air- 
craft is killed. (Note that only one free defender can engage 
a free bomber.) Under this scenario the combat process can 
be represented by the state vector {B(t),C(t),D(t); t > 0} 


where: 


B(t) = The number Of enemy Bomvers tucemtams 
alive) ak times, 
C(t) = The number of enemy bombers (in turn 


defender aircraft) 12n Conoat ace, 
engaged) “at. eime ec, 
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ieee nc number Of Defender aircraft free (and 
alive) searching for a free bomber at time 
ee 
Let Ch be the rate at which an individual defender in 
combat with a bomber kills that bomber (or causes a bomber 
to become ineffective); and Cp be the rate at which an indi- 
feudal bomber, in combat with a defender, kills that defender 


(or causes the defender to become ineffective). 


DBetine 9 to be the rate at which an individual free defender 


detects and starts engaging a free bomber, i.e., § is the 
re-engagement rate. The units for these variables are given 
below: 


defenders killed 


B (bombers) (time) 
ae bombers killed 

D (defenders) (time) 

9 bombers engaged 


(defenders) (time) 


Note that the total number of bombers alive at time t is 
given by B(t) + C(t), and the total number of defenders alive 
meet ime t 1S given by D(t) + C(t). 

Next, the simplest representations for the variables 
Per), C(t), D(t) will be presented: the process of mutual 


mimes rtion is taken to be deterministic. 


POE LERMINISTIC MODELS 
To simplify the representation of the combat process 
mualysis, we introduce a deterministic representation of the 


als 


process by suppressing its randomness. Such a deterministic 
model often, as will be seen later, results in representations 
that deviate somewhat from the expectations of more sophis- 
ticated stochastic process models; such deviations may be 
referred to as the bias of the deterministic model. Ucu aaa, 
the bias becomes small as B(0) and D(0) increase. 


1. The Finite Re-Engagement Rate Combat Model; (the 
BCD Model) 


First consider the situation described in the previ- 
Ous section in which 6, the re-engagement rate, is finite. 
The parameter 98 presumably increases if the defense er system 


1S improved, but no attempt is made here to model Se ina 


detailed manner. 


Define the following functions: 


b(t), a representation of the number of bombers 
free and alive at time t, given the initial 
number of bombers and defenders entering combat 
abi g ale say bal ame 

c(t), a representation of the number of bombers 
and defenders engaged in combat at time t, given 


the initial number of bombers and defenders enter- 
ing combat inieaaiek = 


d(t), a representation of the number of defenoers 
free and alive at time t, given the initial num- 
ber of bombers and defenders entering combat 
sei gist aren iol ILS 

RESULT (4.1): 


A deterministic model for the above scenario is givens, 


the following system of differential equations: 


ob ee 


aot et ) 











at = apce(t) - 6b(t)d(t) 
Te = G6b(t)d(t) - (agtap,)c(t) Dy 
aie eee (=) ee ci(ts) ciccy 


faery initial condition: 


b(0) = B(0) 
oj — ae (0) = 0 
Gueon en — nl) ( O)) 


The argument from which the equations is derived is 
as follows. 

The first equation of (4.1) represents the rate of 
change of b(t) with time. The term anc (t) represents the 
expected increase in b(t) caused by a bomber killing a defender, 
while the term @6b(t)d(t) represents the decrease in b(t) 
caused by a free defender detecting and engaging a free bomber. 

The second equation of (4.1) represents the rate of 
change of c(t) with time. The term @b(t)d(t) is the expected 
increase in c(t) caused by a free defender detecting and 
engaging a free bomber, while the term (ata) c(t) represents 
the decrease in c(t) caused by a bomber killing a defender, 


@meeby a defender killing a bomber. 


HE 


The third equation Of (4.1) represents, Enewracemor 
change of d(t) with time; the argument used for writing this 
equation iS the Same as that fetes enomedie 5 2 eo rlatnlo me 

Equations (4.1) can be solved numerically using Runge- 
Kutta method (Gerald, 1984) but not in simple explicit 
closed form. However, a limiting analysis can be as follows. 

Adding the first equation of (4.1) to the secomepmem 


the third equation to the second of (4.1), we get: 


eh Ge) are (G8) 


dt = ae oe 
(4.2) 
GiciGe) =Cile eer 
= dee ie 
Define the following: 
b(t), a representation of the total number of bombers 
alive at time t, and 
d(t), a representation of the total number or detemaers 
alive at time t. 
Then: 
be) =, Dit) rece) 
(4.3) 
d(t) “= 9 a(t) ree) 


Substituting (4.3) into 4452), swe ebeain: 
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dt ee ia 
(4.4) 
dail = = a, c(t) 
From (4.4), we get: 
Integrating both sides of (4.5), we obtain: 
d_n(b(t) - b(0)] = anld(t) - d(0)] , Vt (4.6) 
But from the initial conditions: 
nO) = BO) C(O). = B (O) 
and 
ae = b(0) + C(O) =" D0) 
Therefore (4.6) becomes: 
eee = BiO)) = oa tate) = pto)) vt (a7) 
Since a., a. and c(t) assume nonnegative values, then 


B D 


f2e4) indicates that b(t) and d(t) are both nonincreasing 


functions (as they should be). 
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a. Criterion for Defenders to Win, BCD Model 
A criterion for the defenders to win can be 
Obtained by noting that, in order to conclude that defenders 
won, it must be assumed that b(~) = 0, and d{~) > 0. “UWsamd 


this assumption, and letting t > ~, (4.7) becomes: 


And () = aD (0) - a,B (0) (4.8) 
Since Ans One d(~) are all positive values, then: 
Ot yD (0) - a BO) > 6 


Therefore, for the assumption that defenders win to be true, 


we must have: 


aD (0) > a ,B (0) (4.95 


Hence, the condition for the defenders to win is 
expression (4.9). If the inequality is reversed, bombers 
win, i.e., some bombers survive. 


Equation (4.8) also shows that: 


a. D'(0) = sas 0s 
d(e) =. 223 =a (4.10) 
Si 6 


Therefore, the deterministic approximation for 


the number of defenders eventually surviving combat is 


Wes 


mieeeencaene Of Ehe rate of engagement @. This is not sur- 
prising, since time extends indefinitely. Of course an equa- 
meen, comparable to (4.10) predicts (approximately) the 
expected number of bombers surviving if (4.9) is reversed. 


Zeeeoune Infinite Re-Engagement Rate, Invulnerable 
Defender Model 


To simplify the representation of the combat process 
we can assume an Invulnerable defender's model (I scenario). 
Under the I scenario, we assume that the air defense system 
Moyoea perfect eS system represented by having 9 = ~, and that 
defenders are invulnerable, i.e., a, = (7 eand only One-to-one 
engagement is allowed. 

an Deterministic Model for E Scenario 

Under the I scenario assumptions, the combat 


process can be modelled deterministically by the following 


differential equation: 


| =D (0) Le I CE) SDK} 
= (4.11) 





| ~a,b (t) menses) << 1B 0) 


Pee Initial condition: 


Boauation (4,11) represents the rate of change of 


Peeeewith time. At any point in time if b(t) > D(0) then all 
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defenders are in engagement (1.e 


waee 


no free defenders), 


and 


there are b(t) -D(0) free bombers. This is represented by 
the term AyD (0) - If b(t) < D(O) then all bombers are being 
engaged (i.e., no free bombers), and there are D(0) -b(t) 


Free defenders, which jUStities Che@eeriiese es 





The solution for equation (4.11) 
as follows: 
Define: 
t* <= “Gnetes t S5@7y 5 ee enone 
Then, equation (4.11) becomes: 
= OD (0) imeem ye t* 
AaiCt) = | 
dt 
| = a yb (t) fOr «te pr. 
where: 
b(0) = B(0) 
Note Chat 1 BCC) D0) seem es 
solution tor (4.12) as "given b:. 
TO nt 
b(E)e- = BEGG ce boas = 
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can be derive 


(4.12) 


(47. 13)) 


Suppose B(0) > D(0). Then equation (4.12) says 
that there exists a time point, t*, such that for any time 
feemieese tess than t~, 0 < — < t*, the rate of change of b(t) 
is -a,D(0). Recall that only one defender can engage a free 
bomber, so while bombers outnumber defenders, the rate of 
decrease 1S proportional to ere defender numbers. After the 
point t*, b(t) declines below D(0), where its rate of change 
becomes “a pnb(t). 


Oia ee we: ae 


db (t) 


“heb 


Integrating both sides, and using the initial 


@enmaition, we obtain: 
ages) eee 0 lear DO hore. < «b* (Ae) 


For t > t*, we have: 





Apt 


Adding py (t) BOwbOunecrdes, multiplying by e¢€ ; 


ema integrating, we obtain: 


e Big es =e biG.  =- £02 for -t > t* (4,15) 


NES, 


From (4.14), we obtain: 


b(E*) "= 8(0)5= ApD(0) t* ; 


Oh 


substituting into (4.15) and mutcioly iio, ” , we obtain: 


—O. (t-t*) 
Bet) <=] Caxe = a yD(0)t*)e £OG (oats 


Hence, from (4.14) and (4. 16)% deste vlevseenae. 


t* 


| A 


( B(0O) - apyD(O)t POs’ c 


~O, (E-t*) 


| (B (0) —a@, DiO)E“ye 1 Op Ge eae 


From the definition of t*, we have: 


Substituting into (4.1/7) we get: 
bCEA SS SRO) es a, D(0)t* =D (0) 


Hence, 


t* = (B(0) - D(0))/apD(0) 


Hhiei(0 


(4.16) 


(4.17) 


Fquation (4.17) permits the easy direct computa- 
mem Of b(t), the approximation for the number of bombers 
Perye at Various points of time during the combat period. 

Note that in the preceding analysis we have 
assumed that the force levels are continuous variables. This 
is an assumption that we had to make in order to use the 
above differential equation models to develop deterministic 
representation for the evolution of the combat process. The 
tacit assumption of a deterministic process is perhaps even 
more questionable. Thus, we should develop stochastic analogues 
for the above deterministic models. A natural procedure is 
to utilize diffusion models; see Feller (1971). 

In the development of our diffusion models 
we assume: (i) continuity of the force level variables, 
and (ii) Gaussian increments included in the process. 

We first consider a deterministic model, and then develop 


its stochastic analogue by representing the evolution of the 


combat system by a diffusion process, i.e., as if it evolves 
with independent Gaussian increments. Since the force 
Hevels (B(t),D(t)) are assumed to be continuous, the 


diffusion mathematics result in a mean and a covariance matrix 
that are approximations to the corresponding matrices that 
would occur if the process was modelled by a continuous-time, 
discrete-state Markov process. However, diffusions often 
yield good approximations with improvements occurring for 


mimge torce level (B(0) + ~, D{0) + ~). It follows that the 


de Sel. 


diffusion approximation can be used to approximate the MOE 
under study, which requires approximating the probability 


distribution of the number of free bombers at time t. 


E. DIFFUSION MODELS FOR AR-Te@-A7 hee ear 

Following the arguments in Gaver and Lehoczky {1977a), 
we now formulate the combat processes resulting from 
modelling the previous scenarios by diffusion processes. 
Since we assume the continuity of the state variables, 
we will, therefore, adopt the following notation: 


B(t) a stochastic diffusion representation for the 
number of bombers free (and alive) at time t, 


C(t) a diffusion representation for stnesmunsen on 
bombers (hence defenders) in engagement at time t, 
and 


D(t) a diffusion representation for emeoumumnber on 
defenders free (and alive) at time t. 


1. Diffusion Model for the BCD Scenario 

Define N to be the total number of aircraft of both 
forces available for combat initially, i.e., N = B(0) + Diagee 
We aim to characterize the air-to-air combat process approxi- 
mately when N + ~, by treating ieee) eGo abv) s ie O} as 
a trivariate diffusion process. When N + ~, we mean that 
B(O0) + » and D(0) + » simultaneously and in a fixed proportion. 

The behavior of the system state vector, {B(t), C(t), 
tor t > O}, can be modelled directly by writing it injeme 
form of an Ito stochastic differential equation as followss 


Arnold (1974) 


GZ 


AB(t) = aC(t)dt = 5 Ben (tat + Vo,CCE)aW, (t) 


- VOB (t) D(t) dw. (t) 


dct) = 6B(t)D(t)dt - (a,,t0,,) C(t) at - V(a,to,)E(e) div, (t) 


Tey CE Ge) Dit) dw. (t) (4.18) 


dD(t) = a,.C (t) dt - §B(t)D(t)at - Vo Cty dw, (t) 


+7 6B (t) DB (t) dW, (t) 


where {W, (t) We (t); t > 0} is a bivariate standard Wiener 
process whose components are independent. That is, each com- 
ponent is normally distributed with zero mean and variance 
Cie. 

The rationale for writing (4.18) is as follows. The 
Mmeeerns represent the drift or the expected behavior of the 
State variable, [B(t),C(t),D(t)], between t and t+dt. As 
viewed by Gaver and Lehoczky (1977a), the evolution of the 
process can be considered as being that of a locally Poisson- 
ian process of rate ONGE)) eB(t)D(t) and AG (ts) for B(t), C(t) 
and D(t) respectively, with the average output rates being 
6B(t)D(t), (omrrc a eK) and BB(t)D(t), respectively. 

The term a,C(t) in the first equation of (4.18) 
represents the expected increase in B(t) caused by a bomber 


killing a defender, while the term of OCS) jal Piel avo mel guna 


Psy, 


equation represents the expected increase in D(t) caused by 

a defender killing a bomber. The term 6B(t)D(t) used in 
eguations (4.18) represents the decrease in B(t) (hence D(t)), 
and the increase in C(t), caused by a free defender detecting 
and engaging a free bomber. The variance of the Poisson 
equals the mean, and for large parameter values (in this 

case large number of initial bombers and defenders) the Poisson 
is approximately Gaussian; this heuristically justifies the 
coefficient of the Wiener process terms, and the Wiener terms 
themselves. An increase in B(t) indicates a decrease in the 
total number of defenders alive (D(t) + ecane and vice 

versa. This is represented by the coefficients of the Wiener 
processes in the first equation of (4.18) having opposite 
signs than the corresponding terms in the third equation. 


Consider the linear transformation: 


B(t) = Nb(t) + YN X, (t) 
C(t) = Ne (t) + /N X(t) (eo) 
D(t) = Na(t) + YW X(t) 

where: eee Bee and ae are deterministic functionsmem 


time, being approximations to the process means which need 
to be determined. {X. (t) i t > 0}, i= 1,2,3, are stochagwme 


elements all of which need to be determined. WJustifticatier 
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of such transformationsis given by Gaver and Lehoczky (1977a). 


Differentiating (4.19), we obtain: 


Os 
ve 
ct 
II 
Zi 
Qu 
On Ms 
ss 
~ 
= 
Z| 
Os 
va 


1 el 
aC (t) = Ndc (t) poy AX, (t) (4.20) 
aD (t) ~ Ndd (t) + Y/N AX, (t) 


Suppose Xx, (0) —07 ta — le omen: com (4, 19). we 


Sebtain: 








_ Eo) 
b(0) = N 
eG sD) (4-21) 
: a By 
d(0) = N 
Let §@ = @N be constant as N > ©; 1.e., assume that 


6 is small enough so that 9N > constant as N > », This means 
that on the average a defender takes a relatively long time 
me detect and engage a bomber. 

Now, substmemting (4.19) and (4.20) into (4.18), and 
isolating terms of order N and YN and letting N > ~, we 


obtain the following sets of equations. 
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a. Deterministic Equations 


The terms of order N yield: 











db(t) _ : bee 

ptt) = a.c(t) - sb(t)d(t) 

Sett) = eblt)d(t) - (agtap)e(t) (4.22) 
Sith = a clt) = ebiejace) 


with inaitialwconditaens given by (42 

The solution to these equations, which is obtained 
by numerical integration, provides a deterministic approxi- 
mation to the means of the process. Note that equations (4.22) 


are equivalent to equations (4.1) where, 


b(t) = Nb(t) 
Sete Nees 
ace) eencies) 


This shows that the diffusion approximation results in the 


same approximations for the means as the deterministic model. 


JBoss 


bem eecnaseye Houati1ons 


The terms of order N yield: 


dx, (t) {-6d (t) X, (t)+a,X, (t)-8b (t) X, (t) }dt 


+ VOC (t) dw) (t) - Vb (t)d (t) dw, (t) 


(6a (t) x, (t) ~ (Opt0,)X5(t) + Ob (t)X, (t) Jat 


dX, (t) 


ALR 
(a, +0,,)E(E) dW, (t) + JB (t)d (€) dW. (t) 


dx., (e) {~ed (t)X, (€) +0,X, (t)-@b (t)X., fe) dt 


- Von (t) dw, (t) + /6B6(t)d(t) dWw., Gz) 


RG werte (4.20) In a Matliegerorum. let: 


X(t) 


ba Gere, (oles. Can 


and 


W(t) [W, (t) We (t)) 


Mnen, (4.23) becomes: 


oe 


(4.23) 


——— 
~am~n ~ea 


SECne) OL maclOh ic), 


B 
aig) eS Gd(t) -(apto,) @b(t) X(t) dt 
-Ad (t) ™ 9b (t) 
/o,,6 (t) - /SB (ty alt) 
+ | -/(agfa,)e(t) — YSB(E) ACE) dW (t) 
/o,E (te) JBB (tya (tb) 


which appears in the form: 
+ ~ ~> 
dX(t) = At G) Xe dite ee) ee ace) (4.24) 


where A(t) (a 3 x3 matrix) being identified as the coefficient 
of (X,(t),X, (t),X,(t))", and v(t) (a 3 x2 matrix) identi- 
Fied as the coefficient of the Wiener process term. 

Now, since X (0) = 6, and b(0), c (0) and ac are 
given by (4.21), then by appealing to the central limit 
theoren, for allt > 0, [X1 (t) ,X, (t) ,X, (t) | has a trivariate 
normal distribution with mean 0 and varliance-covariance 
matrix 2(t) which satisfies the following differential 


equation; Arnold (1974): 


G_$ie) 2" Ate)e Ge) + pleas Ce) ve) (4.25) 
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Recall that 


B(t) b(t) X, (t) 
C(t) = Be) + YN X(t) 
D(t) ae) x4 (t) 


Therefore, we have obtained the following: 


PeouLl (4.2): 
Pie C( tj) Ge lc tai amtate. mormal- (Gaussian), 
as N (hence, B(0) + D(0)) > ©; where B(0) and D(0) + ~ 


Simultaneously and at a fixed proportion: 
Meme c(t),D{t)} = Normal (N(b(t)c(t)d(t)),NZI(t)) 


From Result (2.1), it 1S possible to estimate 
the probability that at least a specified number of enemy 
bombers are free at time t, which is a useful measure of 
effectiveness (MOE). 

The deterministic equations (4.22) and the equa- 
mom (4.25) for the covariance matrix Y(t) can be solved 
by numerical integration. 

By eeneesegulcedectipsrbheuclon and multiplication 


men get : 


oe 


———_———— 
ad 


ac(t)+6b(t)d(t) voy (gFanJe (t) 


-6b (t)d (t) -8b (t)d (t) 
vievi(t) = | -YagT@yFapye(t) — (agtape(t ap GgFap eit) 
-6b (t)d (t) +6b (t)d(t) +6b (t)d (t) 
~Ver gc (t) Ja (ait) (t) a,c (t) 
-6b (t)d (t) spele enclicc) seed Oig ellie) 
Wis ite Uric. 
O43 (t) O19 (t) O13 {t) 
R(t) = O75 (t) G55 (t) O53 (t) 
0,3 (t) O53 (t) O43 (t) 
Equation (4.25) becomes: 
SUS aera) Se) 2 Jn Ce) 
Ge 
with initial conditions: 
$(0) = 6 
where 
>T 
(t) = (0, (t) O15 (t) O13 (t) G5 (t) O53 {t) O33 (t)) 


VO1,0C (t) 


(422169) 


G(t) is shown on the next page and H(t) is shown below. 


anc (t) +b (t)d (t) 


Sy aentomera Nol) bit) die) 


H(t) = =v amine) - 6b(t)d(t) 
(a nto.) (t)+6b(t)d (t) 
V0.5 (gto) C (t)+0b(t)d(t) 
ané (t) +b (t) d (t) 
D.. 


DiELuSion, Model for Ehe 1 Scenario 


Under the I scenario we can characterize the combat 


process approximately when B(0) > ~, and D(0) + ~, by 
meeemeeng {5(t); t > 0} as a diffusion process. 


The Ito stochastic differential equation is: 


-opD(0)at - YD (0) dw(t) for B(t) > D(0) 
Bec) = 


(a7 7) 
—OpB (t)dt - Yo, (t) W(t) eee e@reict )) <D( ©) 
Equation (4.27) is written using the rationale used 
for BCD scenario. Let 
DCO) = Fe Bio) (A228) 
where: 


Oj © 1S £isved 


se) lk 


Co 


(“0404 (a) G9) - 
(3) G92 


dy 


(4) o- 


0 


( (4) q+ (3) PO) = 
(3) 46 


(3) q9z- 


(Cro+"0+ (3) PO) — 


Gos 


hoe 


@emsider the following linear transformation: 


0 


B(t) = B(0)b(t) + YB(O) X(t) (4.29) 
Differentiating (4.29), we obtain: 

dB(t) = B(0)adb(t) + /B(O) dXx(t) (4.30) 
S@eeuituting (4.28)-(4.30) into (4.27), we obtain: 


—0,,6B (0) dt-Vo,.8B (0) dw (t) 
if B(0)b(t)+/B(O)X(t) > D(O0) = 6B(0) 
B(0) db (t) (4.31) 
+VB(0)AX(t) ~ 
~c, [B(0)b (t) +¥B (0) X(t) Jat ot [B (0) b (t) +VB (0) X (t) Jaw (t) 


if B(0)b(t)+/B(O)X(t) < D(O) = 6B(0) 


Isolating terms of order B(0) and VB(0), and letting 
B(0) > ~, we obtain the following sets of equations. 
a. Deterministic Equations 


The terms of order B(0) yield: 
05 De sae) > a6 


= (432) 


—ayb (t) et. Geyer 0 


oS 


Let t*®#=6aniGiae t SROMencieeGe) <a 


tion (4,32), it follows enac. 


aL 5 SLE ee eK 
diate)? | 





-a,b (t) if to> ts 


from equa- 


(45.33) 


Suppose X(0) = 0, then from equation (4.29), we 


obtain the foelslowamg intial condition 


b(0) 





therefore using (4.34), we obtain: 


For t > t*, we have, from equation (4.33): 
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(4.345 


(4.39) 


Hence: 
t* 


oan s O 
Pee b(t) - bitje = Q for t»> ts (4.36) 


From equation (4.48), 


Substituting into equation (4.36), we get: 


L-a,6t ILO RAY om ey 
b(t) = Cae a7) 
a, (E-t*) 
(l-a,dt*)e ioe = (8 Gee a 
but from the definition of t*, we have: 
b(t) = 6 
substituting into (4.37), we get: 
b(t*) = 1- a,ot* = 6 
Hence: 
tx = a (4.38) 
=D 
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b. Stochastic Equatiems 


The terms of order VYB(0) yield: 
-V0,5 dw (t) FOr ¢ sem ceet. 


adxX(t) = (4.39) 


“On X (t) dt-Vvanb (t) GAW(t) TroOr™ te. 


For € <- €*,. Grom) equaeren (4.39), we get: 
aX(t) = = Vans dwit) 
Integrating both sides, we get: 
X(t) - x(0) = ~Va,6 (W(t) - w(0)] (4.40) 


Taking the expectation of both sides of equation (4.40), we 


Obtain: 


Taking the variance of both sides of equation (4.40), we 


Obtain: 


Var (CE) =) Soe e 
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fee, LO t.< E~, X(t) is normally distributed with zero 


mean and variance aot. 


POGpeuwwemee*, from equations (4.37) and (4.39), we 
Riel: 
—O, (t-t%*) 
att) = “A,X (t)dt - Gp (l-a,dt*)e aw (t) 
ot eeele -a. (t-t*) 
ee, D cafes aay : - D 
arte mk), = e ay (1 apdt ye dw (t) 
oO 
F(ttt*) 
a _ = a4 
Vo, (1 andt Ve dw (t) 
Integrating both sides we get: 
O * 
Apt a, t* st 
e X(t)-e Sates) = By onc ealead e 
O 
iE +t 
x il e aw (tT) 
t* 
LAWS , 
t* 
—a,, (t-t*) Sie ye ~ a, (t-—=5) 
iace) 26= 0 Ce ce Von (1a St*) e 
O 
ie + i 
x fe dw (t) (4.41) 
t* 


Meee 


One 


D 


Since the function e is a deterministic func- 
tion then it is a nonanticipating function. The function 
g(s) is said to be a nonanticipating function if, for each 
s, g(s) is independent of {W(t) -W(s); t > s}; where W(t) 
is a Wiener process with mean zero, and variance t. That 
is, g(s) is independent of the future increments of the 
Wiener process after time s; Schuss (1980, p. 63). Hence, 


the integral 


is a stochastic integral (Arnold, 1974) and is a nonantici- 
pating func&kion (Schuss, Sloss 
Now, by appealing to theorem (4.4.2) in Arnold 


(1974), we obtain: 


esp 

oe 
Ef f e shia) |) Sores (4545 

= 
and 
ona 
t = ; to eh 
Pir y se dw(t)}°] = foe dt (4.43) 
t* t* 


Jesh 


It follows from equations (4.42) and (4.43) 


Gaat: 


var{t fe dWit)] = fe -e } (4.44) 


Taking the expectation of both sides of equation 


(4.41) and using equation (4.42), we obtain: 


“ap, (t-t*) 
eect) | = Sec Bee ) 
Pie x(t*) ~ N(O,a,5t*). Therefore we get 
E{X(t)] = 0 fe@its ta ate 


Taking the variance of both sides of equation 


(4.41) and using equation (4.43), we obtain: 


tx 
—2a_. (t-t*) —2a_. (t—) t at* 
Wemix(t)) = e Var (X(t*) ) +o, (l-a,st*)e e 2 lie D -e . ] 
5) 
—-2a_ (t-t*) —a.(t-t*) —-2a_(t-t*) 
= a,,ot*e e + (1-a,5t*) le “D -e e ] 
Therefore, for t > t*, we have: 
~20, (t-t*) mer (t-—t*) On (t-t*) 
ie) ~ N{0,a,,dt*e +(1-a,,dt*)e (l-e a; 
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We can summarize the above calculations as: 


RES Uli ae 


As B(0) + © (hence D(0) + ~), B(t) is approxi- 


mately normal (Gaussian). 


S(en meee N(B(0)b(t) ,B(0) Var (X(t) )) 


This result can be easily used to compute leakage 


probabilities in terms of D(0). 


F. A MEASURE OF EFFECTIVENESS: ~AN APPROAIMATION 

The diffusion approximation results in the same approxi- 
mations for the process means as thoSe given by the solutions 
of the corresponding deterministic models of the previous 
section. It has been shown above that, in addition to develop- 
ing approximations for the process means, we are able to 
derive expressions for approximating the variance-covariance 
Matwix “of \edchmeuocess. 

Note that the dimension of the system of differential 
equations resulting from the diffusion approximations is not 
a function of the initial size of the forces. For example, 
in the BCD scenario, we need to solve a system of 3 differen- 
tial equations to solve for the deterministic means, and to 
solve a system of 6 differential equations for the variance- 
covariance matrix. This allows military analysts to economi- 


cally model combat processes for larger size problems. [It 
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also allows military OR analysts to derive expressions for 
approximating (or estimating) probability statements that 
represent measures of effectiveness (MOE), and to compute 
their values without expenditure of excessive computer time. 
That is, a useful MOE can be approximated analytically, and 
in near closed form; the results can be used in a program to 
optimize logistics allocations. For example, suppose that 
the MOE, as stated in the introduction to this chapter, is 

to minimize the probability of penetration of at least z free 
bombers. It is assumed that bombers are not capable of 
delivering their load, or their bombs will not hit targets 
defended, when they are being engaged by defenders. Define 
Tp to be the time required for the bombers to reach the bomb- 
release line (or the hand over line). Then B(T,,) represents 


the number of bombers penetrating. The above MOE can be 


evaluated mathematically by: 
P{B(T,) > z|B(0),D(0)} (4.45) 


mmere the conditional distribution of {B(T,) |B(0) ,D(0)} 
@eeven 6(0), D(0) is given by Result (4.2) or Result (4.3), 
depending upon the scenario under consideration. 

The diffusion assumes the continuity of the state variables; 
it is also an asymptotic approximation, i.e., it gives good 
approximation as B(0) and D(0) become large simultaneously. 


We can relax these assumptions, and evaluate their practical 
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validity, by formulating the combat process as a continuous- 
time discrete-state Markov process. This will require some 


other assumptions that will be stated in the next section. 


G. MARKOVIAN COMBAT MODELS 
Assume that the engagement time between a defender and a 


bomber is Markovian (i.e., has an exponential distribution). 


That is, a defender takes an exponential time with mean On 


to kill a bomber, once an engagement started; and that a 


bomber takes an exponential time with mean an” to kill a defender 
Assume, further, that the defender takes an exponential amount 
of time with mean pore to detect and engage a free bomber. The 
air-to-air combat is formulated as a trivariate continuous- 
time-Markov process. Recall that we continue to assume that 
bombers are arriving simultaneously. 

1. BCD Markovian Combat ocean 

Under the BCD scenario, the state of the process is 


represented by the trivariate-Markov process iB(t),C(t),D(t); 


t > 0} operating on the state space S; where: 


Me Chia), Ge) Sa) 


[Ax 


By O-< j+K < D7 0k was, 


i = 0,1,...,B; j} = 0,1,...,min(8,D); k = 070 eee 


During a small interval of time (€,e+dt}], the State ehayaee 


occur with the following probabilities: 
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te 1c FOE Probability 





ee, 3k) : Ely gai) k) £,(1,),k)dt ve 1) Gna), 
> (elie llc ]) £o(1,j,k)dt + o(dt) 
(4.45a) 
= Cie, el) £,(i,j,k)dt + o(dt) 
> ee a) ie tf ieee) at + OC t) 
where for the current model 
£3 (1,3,k) = oe, 
foli,)3 a) = ona 
EE oy) 
£5 (1,3,k) = Oy) 
fej = £,(1,3,k) - £4(i,j,k) + £ (1,3 ,k) 
Let, 


In what follows, for simplicity of notation, we will 


Suppress the initial condition, and write: 


20S 


Apparently {B(t),C(t),D(t); t > 0} is a finite stage 
space multivariate death process, as defined by (4.45). 

The forward Chapman-Kolmogorov equations are derived 
by writing the probability that the process is in state (lane 
at time t+dt as a function of the state probabilities at time 
t. The probability of being in state (1,],k) at ime tree 


is, in general, expressed by: 


Pins ,, (ttdt) = eae SETAE Es 5 Final t £. (itl, j-1,k+1) dtp (t) 


ae it] dala 


+ 2 Gal 5 ek eeee (aces. vigedlyisiy ister ue 


SN spall ie i,jtl,k- 


+ o(dt); 


the terms on the right-hand side express the mutually exclu- 
Sive possibilities: (1) no state change, (ii) the number of 
combats increase by one, (iii) a bomber wins an engagement, 
(iv) a defender wins an engagement. 


Subtracting ee 2 ,(t) from both sides and dividing by 


dt, and letting dt tend to zero results in the following sys- 


tem of differential equations: 


= -£(i,j,K)P, . (t) 


ae + £. (itl, j-L,k+1)P, 


ql yl) alae 


(ciel ello) Em (t) 


E Ge) ee yp le ee 


=i eule lol 


(4.46) 
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ee = easweee- 82) If BO) B, and (0) = D, then 
mee anitial condition is: 


| 1 ee ays) | Be 0, D) 


sre es ] 
0 otherwise 
Let 
Gp. 2 (te) 
J — Tele 
Pad ee —— ers 


The forward Chapman-Kolmogorov equations may be 
written out as follows, starting with the above initial condi- 


Pems and recognizing boundary conditions explicitly: 


PB o,p't? = ~£(B,0,D)P, 4 pft) 
PB,0,k ‘© = =e UE USE le ~ £,(B-L,1,k)PR yt) 
Jes Bel 
abe , 
Ps o,p © = £(1,0,D)P; 4 ft) - £y(4,1,D-1)P; yy ft) (4.47) 
1 epee ines i cial 
4 ,k = mE i + Gea) ese ee peal 


gee (Oval, KP (t) k,j>O0 l<ktj<D 


0,j+1,k-1 
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P! (tC) S99 Sb ied 0)e 


(2) fn Olga egal al) 
pepo 1G 0 


2 ag heal peal 


(Pag 1 <itj <B 
+ Bs (i-1,j+1, 0)P,_ ieee g(t ) ag eae) ‘aes 


a -1,k+1)P 
P! .,(t) = Be eo ee + £.(it+1,j- 


C uly etl veel,’ 
pe 


+ i, atl, K)P, (t) + f, (i,j+1,k-1)P. 


i) 
= jr kK 1, jk 


nek eho IP Sicess JE 


ts 2 Seo ae 


P! (t) = -£(i,j,k)P 


(t) + fu lyn KL) Pe 
aegis 


(a4 7) 
+ oy oa bg SE oo a 


Pio elt)-=— =f Gay ie 


(t) + fo (i+1,j-1,k+1)P. 
ay 


ley pk a AU ofall - Ket 


ie (i,j+1,k- oie eae yy &t) 


Lo Seat) Seal ateeae 


Pe (iC) <= ~£(it1,j-1,k+1)P 


(t) 
j-L,k+1 
aig ore. letra 


on = ae a so + foe ay 
ee ee, BD) 
= ae a 
ok EUL,O,K)P. 9 1 (t) -- £, (i L,L,K)Ps_y 1, ft) (4.47) 
(eet: cd) 
+ E(t, Lek-L)Ps a yy ft) 
IG ab Radel Ike Gs Bal 
Po o,k ‘t? En (O,1,K-L)Po 4 47 ft) i = DP 
Eo,0°° = fF G-1,1,0)Ps 1 4 ft) DR es Bsa =) 
Let Ere Kb? be. the Laplace transform for Hg peed 
then: 
ie - ~ =st 
i4,k'S) Zz Pig, (tiat s > 0 


Taking the Laplace transform for P (t), and using 


Epo), D 
maewinitial condition B(0) = B, C({0) = 0, and D(0O) = D, we 


met, from (4.45): 


Ged t 


=St... ae ~ =st 
te  P p(t)dt = -£(B,0,D) 4) e "Pa o.p 


ZO 7 


Using integration by pares, te erollows Cia 


Therefore: 


@ - 1 
Ppo,p'®) ~ § + £(B,0,D) 


Taking the Laplace transform for the genera acm 


Or one in (4.47), we get: 
ne oe ee eee (s) 
ata SFG) € : f i-+i, gai Kel 


eae analy) 


i-1,j+1,k‘® 


+ E(t TAL LPS iy 7 (8) 


(4.48) 


Therefore, we obtain the following system of equations 


FOr, the Laplace” Eranstormms: 


. 1 

Ps 0,p*) S + £(B,0,D) 

ras _ 1 Pay 

Pao, k 8) = StE(B,0,K) fp (Bll k)Phy 1 p(s) il. < a S D-1 
P. (s) a eae D-1)p (s)] 1s 
059 Stt Gi,07 Db. = 1,1,D-l —- = 
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(4.49) 


ras = 1 


s+£(0,j,K) (deed all easly De: 


wa i j-1, ke ©) 


ap ge (Oak hah bs , (s)} 


0,j+1,k- 


kajemOe «| kt < D 


p! (s) ={ : 


-{£,(i#1,j-L,1)P (s) 


Stf(i,j,0 i+1,j-1,1 


% Gods Oe (s) } 


need a hl 8, 


Lan pee i 


= il ° 
ae = SO - ; 
ope” CStEG UR) ce 5-1 ,k1 © 
+ Se isha) /8 aati, pe 
+ EG LAPS 54) 4-1 (8) 3 
ES, oh ce eel a ee | 
eit Sateen ety 1 
P (@) ee i ea (s) 
i,j,k Stf(,4,k) cS Peal kel 
+ fy (A-1, 541K) Psy 547 5 (8)? 


(4749 )) 
(Cons (ch) 


= L a 
Pig 8] sfGa oe) Je ee 
+ En (Le jtL KL)PS ody yy (S)) 
l= eee Sele El 
jt+tk = D tee 
P (s) aE Ps (i+1, 3-1 k+1)P (s)} 
i,j,k Sti mie =e oe i+1,j-1,k+1 
eg eel 1 < k 303 
i+j =B jt+k = D (4.49) 
(Cont "aa 
S 1 : fe | 
ao StF0,7 Oy tte trd-L TP) sy fs) at: 5 < min(B,D) 
Poa (s)) Se (s) 
TOOK st+f(i,0,k) B es: i-l,1,k 
+ fy (i,L,k-L)P; 1 yy (s)} 1<i< Bel 1<k < Del 
4X 1 “w 
Py 0,k 8) gt (0,1,k-1)Py 1 yy (s)} ie keeD 
P. , (8) = =f£,(i-1,1,0)P Gy eee = 
205.0 s B ams = eo a 
Equations (4.49) are in a form that is suitable for 
a recursive solution. Solving (4.49) recursively, we gow 
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> 


PR-1,1,D-1'S) 


nN 


Pa o,p-1') 


ww 


PR-?,2,D-2 ‘8? 


Nw 


Pp-1,0,p'S) 


nN 


PR-1,1,p-2'®? 


nN 


Pp-3,3,D-3 2 


“ns 


Pe o,p-2'S) 


nN 


PR-2,2,p-3'5) 


il 


stf (B,0,D) 


iL 
stf (B-1,1,D-1) 


IL 
st+f(B,0,D-1) 


IL 
st+f (B-2,2,D-2) 


il) 
st+f (B-1,0,D) 


it 


= SE (BaT peat tc ero D LP 


st+f (B-1,1,D-2) 


+ f,, (B-2,2,D-2)P, 


ih 


= STE (B33 Dod) fe (Bo 22 ,D-2)P,, 


Shine (Bio) a) —8 | 


Ih 


= SAE (BoD Lope) tc (B-1-0,D)P, 


s+f (B-2,1,D-1) 


+ £, (B-2,2,D-2)P 


iL 
s+f (B,0,D-2) 


1 
s+f (B-2,2,D-3) 


+ £, (B-3,3,D-3)P, 


{f£,, (B-1,1,D-1)P 
{£,(B-1,1,D-1)P 


{£,(B-1,1,D-1)P,, 


ee Ag Dies 


B-2,2,D-2 
{£,, (B-1,1,D-2)P, 


{£,(B-1,1,D-2)P, 


= 5,3 Joe: 


{£,(B,0,4d)P, 9 p(s) } 


B-1,1,D-1 ‘) ! 


B+1,1,p-1 ‘S)! 


-~1,1,p-1 ‘S)} 


B,0,D-1 ‘© 


(s) } 


-2,2,p-2'5)! 


-1,0,p'*) 


(s) } 


-1,1,p-2 8)! 


-1,1,D-2'®) 


(s) ft 


Zi 


(a 50) 


Fay ik ~ 
0 a ea aes 
Pe-1,0,D-1°©) = SeF(B1)0,De-1) “Be 


— \ 

ah(e 1/1 D2) ane oe 
p (s) = ee eee (s)} 
B-4,4,D-4 s+f(B-4,4,D-4) -"C ae B-3,3,D-3 

(4.50) 

x 1 Fe (Cont ‘am 
Py-3,2,D-2°°) > “sap (eesy2yD=2)t Ge ae ee ese 

+ £)(B-3,3,0-3)P, 5 3 p3(s)} 
p (3) ee ee ae pene on 
B-2,0,D s+f£(B-2,0,D) ~"D or B-2,1,D-1 . 


Continuing in this manner we can solve for the Laplace 
transforms recursively starting from state (B,0,D). 

The state space, S, of the trivariate Markov process 
is a nonempty set of states. Define the set of edges E to 


be: 


B= “{[(i,37k) -(nem,2) 12 (1,9 ,K) ands (nei eer 


and (n,m,2) is accessible  trommay oe 


Sinee 1B (tb) -C Ch ep te > O} is a multivariate pure dceaum 
process, then E is a nonempty set of edges. The edges are 


Ordered pairs [(1i,},k),(n,m,2)] of states. The state (1,),k) 


Paz 


is called the tail and the state (n,m,2) is called the head 


pemmemne Cage ([(1,)],k),(nm,;m,2)]. Let G = (S,E). Then G is a 
directed graph. For a definition and discussion of graphs 
see Aho, Hopcroft and Ullman (1974). Figure (4.2) illustrates 


the graph G. Define the depth of a state (i,j,k) in G to be 
mgemlength of the path from state (B,0,D) to state (i,j,k), 
where the length of each edge is l. 

The set of equations (4.50) shows that by knowing the 
Laplace transforms of the states at the neh depth of the graph, 
then the Laplace transforms for the (n+1)S* depth can be 
calculated for any value of s. With this observation we can 
solve (4.49) by the following algorithm: 


ime cCOMsStruct the graph Of the process. For the nae 


depth find the possible states and calculate its 
faden, i.e€., how many states are in the nt) depth. 
Continue until the width of the depth is zero. 


2. For the nth depth, if width (mj) # 0 then pick a state 


(ay (1,);K)). Then: 


2-l €aleulate the mean _9f the corresponding sojourn 
time. CGE Clea) ) ) 


2.2 Examine all states in the (n-1)S* depth, to 
determine which states are accessible to state 


(1,),k). 


Zo Calculate the Corresponding transition rates 
heenmerne Starceaecerminedmin (2.2) oO (1,),k). 


24 Callen Wate ther Laplace Eramstorm for (1,)],k) . 
Repeat for all states in the nth depen. LE 
WwiGhiaues() (= O0vs EOD. 
Recall, in Chapter III we derived a one-to-one mapping 


between the multivariate Markov-process to a univariate Markov 


process. This mapping has been used for the above algorithm 


Zo 
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Combat 


to be able to store and retrieve the states and their corres- 
ponding Laplace transforms. 

The solutions for equations (4.50), i.e., the Laplace 
transforms can be used to evaluate some measures of interest 
as follows. 

Suppose that the combat duration, Tp is assumed to 
be a random variable distributed exponentially with mean 


ae. Let, 


Ps 5k (Tp) = P{B(T,) = i,C(t,) = j,D(T,) = k| BO) = B, 


C(0) = 0,D(0) = D,T, } 


Following the argument provided for evaluating the 
readiness of the squadron at the time of attack under the par- 
tial surprise scenario, we can express the combat outcome in terms 


Semoeloaplace transform, as follows: 


= Seu 
EIP;  y.(Tpll = ai Pig x (ulée du 


= ae 4.51 

EP, 4g , (8) (4.51) 
The probabilities P. : x bt) can be determined by 

inverting the Laplace transforms P. - KS); see Gaver (1966). 


A measure of interest is the probability of eventual 


Smirevyivors. 


Ze Mes) 


Let: 


7, (B) = P{i bombers eventually survive the combat} 


From (4.47) we get: 


' = | <= 
EO Os a = £1 1,1,0)P; 1 4 of) 
Integrating both sides, we obtain: 
t e 
fe oP (9,g(tidt = fg(i-1,1,0) fi Piiy1,9 (tat 
0 0 
Therefore: 
1 
Pipe) = Sete ) Pi_41,9 (tat 
nm, (B) = Peo O ae 
Sm eye est) | Poy 1,9!) a1 
Hence, in terms of Laplace transforms, 
1; (B) = fpfi-1,1,0)P;_1 4 969) (4.52) 


ZAG 


ites tOllows that: 


B(0) 
E[B(@)] = ) in, (B) 
i=l 
B(0) a 
z i ‘eS iyLy O) Bye yen (4.53) 


Equations equivalent to (4.52) and (4.53) can be 
derived for the defenders by following similar arguments. 
3. Markovian Combat Model for I Scenario 
Under the I scenario, the state of the process is 
eeeven by 1B(t); t > O§. The transition probabilities 


miemprecess {B(t); t > 0} of order dt are as follows: 





ie crate Probability 
aL fe i-l fy (i)dt + o(dt) 
(4.54) 
a 1 1-f, (i) dt + o(dt) 
where in this particular case 
12 (le) a, minti,D(0)} ; (ess) 


Actually, the remaining results hold quite generally 
mememaroitrary £. (1). 
fre a=—oGiemanad Be= B(O) The stochastic process 


{B(t); t > 0} defined by (4.54) is a pure death process with 


Zany 


state space {0,1,...,Bl;: see e.g-, Peller (lou) Gio 


14. The parameters of the process are given by: 


£2 (v=) (Gee ae 


b (4. 5G 


| 
tlh 
O 
2 
Fh 
O 
a) 
_ 
HI 
O 
to 


Let: 
Pires Ge) = pyect) = 3|B(0) = (4.57) 


For simplicity of notation, we will Suppress the 


initial condition for the moment, and write: 


P(t) = (Pa. te) 


The forward Chapman-Kolmogorov equations can be 
derived, as in the BCD case; l1.e., the probability of being 
in state (j) at time t+dt is expressed by: 


Pa(ttdt) = (1-£,(j)dt)P, (t) + £p(j+1) dtp.) (t) + o(dt) 


5 AL 


tie LOI OWS that. 


Zane 


ivereetOore, the forward Chapman Kolmogorov equations are: 


Pg (t) = £,(1)P, (t) 
Pi (t) - ~£(5)P, () 4 Ep (G41) P, 4) (t) ite eel (4558) 
ete) ~ ~£, (B) P(t) 


Tee tnitial condition: 


P.(0 = 
yi? | 
0 otherwise 
Let P.(s) be the Laplace transform for Ba ele Then: 
a © est 
P.(s) = fe P,(t)dt s > 0 


Lacing tene Laplace tramstorms ©£ (4.58), using inte- 


Meceron by parts and applying the initial condition, we obtain: 


A i 
Baas) = 

B £,(B)+s 
P. (s) = Eyes Pp tit) P 5,1 (3) 1 <j < B(0)-1 (2259) 
era fe. (1) P- (s)} 

io Se sD tee 


AALS, 


Notice that (4.59) is already in a recursive form. Sctareane 


from state B(0) and proceeding recursively, we get: 


3 i 

P,(s) £,(B)+s 

es 

B-l - eS ene £,,(B)+s 

5 te) = eh 
B-2 £, (B-2) +s f (B=)es 2 ere 


Continuing this way, we get: 


ae 
5 7 £,(j}+s 


B £,(n) 


n=jtl fi (n)ts 


Therefore, the solution for (4.59) 1s as follows: 


a ale 

Pals) £, (Bits 

x 1 B £5 (n) 

Pats Y= Il 1 <j < Bel (4.60 
J £,(j)+s n=j+1 f,(n)+s a te ge 

p (s) = zs i 2 
0 S 4) £,(n) +s 


Note that the term £,(n)/(£, (n) ts) refers to the Laplace 


transform of the time spent in state (n). 
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a. Evaluation of Measures of Effectiveness: il 
Model 


A useful measure of effectiveness is to compute 


fmemprobability of at least z bombers alive at time T. (recall 


B 


Tp is assumed to be deterministic) in terms of B(0) and in 
particular, D(0) = D. The latter is influenced by logistics 


considerations. The probability of interest is: 
P{B(T, > 7A Vie) (0) DOI I) 
Note that: 


B 
P{B(T, > z|B(0) = B,D(0) = D} = » Par 
j=2t+l J 


(4.61) 
The probabilities Ps (t) can be determined by 
inverting the Laplace transforms Pits), see Ross (1983b). 


Suppose T, is assumed to be exponentially dis- 


B 
tributed with mean gs Then as in the case of BCD, we 
can express the probability of interest in terms of the Laplace 


M@ramsrOrms; 1.e€., it can be shown that: 


BoA 
Bite 2B) - B,D(0) = D,T,JT = € ) P.(é) (4.62) 
Z=2+1 


PAPA 


If we continue using the assumption that bombers 
being engaged by defenders are considered to be ineffective, 
then a measure of interest is to compute the probability of 
at least one free bomber reaching the bomb release line. Hence 
the probability Of Snterest |) Sia ecle) ae D(0) |B(0),D(0)}. 


To evaluate this probability we construct an equivalence 


relationship with the sojourn times of the process in every 


state. 

Let Ra j = 1,2,...,B(0), be the sojourn times 
For 1B(t);. t > 0) in-state a.) Precotenc, Xa | = lL. 
are independent random variables, each with an exponential 
Gistribution FY (x) =" le 3 oe that has a rate Da, L Om 
J = ee and a rate J Op fOr gie— LZ, eee 

The event {B(T_) > D(0)|B(0) = B,D(Q) = D} is 


B 


equivalent to the event that the B(t) process at time T. 
is at state j such that j ¢« {D+l,D+2,...,B}. 
Let S, be the waiting time until there are exactly 


D bombers alive. Atthis point each bomber is being attacked 


by a defender (according to the present model). Then 
B 
Ss. = Dee (4.63) 
: j=D+1 
Thus, sone (event ny D(O0)|B(0) = B,D(0) = D} 
1S equivalent to the event iS, > Tees) Sl, = B,D(0) = Di. Wemae 


Sp is a sum of i.i.d. exponential random variables with rate 


Zee 


Do, - Therefore, the conditional distribution of Sp given 


Eeey = B, and D(0) = D, 1s Gamma (B-D,Da,) . 
Hence: 
PIB(T,) > D|B(0) = B,D(0) =D} = P{S, > T,|B(0) = B,D(0) = D} 
B-D 
- | (Dot) B<D-1 nae 
a (B=D-1)! = 
B 


Therefore, we obtain: 
P{B(T,,) > D|B(0) = B,D(0) = D} = et 8.0 (4.64) 


Another measure of interest 1s to compute the 
expected number of bombers alive at time t, i.e., E[B(t)|B(0), 
D(O)J]. To simplify the notation, we will temporarily suppress 


m@en initial condition, and write: 
E[B(t)] = E[B(t)|B(0) = B,D(0) = D] 


From the transition probabilities of B(t) of order dt given 


by (4.54), we get: 


Jey ne) with probability 1-f,(B(t))dt 


Bl(ttdt) = 


| B(t)-l When pe@bability fF, (B(t)) dt 


22 


E[B(t+de) |B(t) = (Ete eeeeee picks 


Taking expectation of both sides, we get, 


E([B(t+dt)] = E[B(t)j] - fre is) 1) |e 


Subtracting E[B(t)] from both sides, sdividimgeb, de and 


letting dt tend to zero, Gives: 


E'(B(t) ] -E[£,(B(t))] 


From (4.55), att follows tec: 


D B 
BE 1Bte)} 1) — oe. CRIP eee. fe) (4.65) 
4=0 J j=D+1 J 
B 
Adding and subtracting ) Cry ve! to the right-hand sade 
j=D+1 
of (4:65), we obtain: 
B 
BY IB(e)] = =e BBE) ao i ce) eee (4.66) 
jJ=D+1 J 
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Heom (4.60), we have, 


n 1 B fy (n) 
Ee. = =—— II —————____. D+1 a 
**? poe ne | eee - 
. Crm a 
e (3) aro Dee 5 Eee (4.67) 
J (Da en Itt ——, 
since 
£549) = Da, oe ea 


Let LT {P;(s)} denotes the inversion of P.(s), 


then: 


p.(t) = L t{P.(s)} 
B-) 
ee (Da) 
(Da fe “lord. 
B-j 
(Da_) =Da_t 
D B-j D Dt+l <j<B 
Bae) jaye is e 
Pmisaseituting into (4.78), we obtain: 
B (Dat) J =a 
fees (tc) | = “ap, EIB(t) ] ote On ) (SD) Bas 0 Se 


Adding pF LB (t) | to both sides of the above equation and 
ioc 
multiplying by e , we obtain: 
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3 at 5; (Da ee! ~(D-l)a,t 
—-{e ~ E[B(t)]} = a (j-D) —=—— e 
dt D rel (B=43)! 
Integrating both sides, we obtain: 
Opt Be Oj) (Da,,,) ae t pn ~(D-l) apt 
e E(B(t) )-BI(B(0)] — a ) — eos ~«6fdhutll le dt 
Dine Bia 
j=D+1 0 
; k 
Ot : Genre ~(D-l)a,t B-j ((D-1)a,t) 
oe BiB Ce) =6 a l-e in 
i=D+l (D-1)~ 2 k=0 


By transforming indices, we obtain: 


=—q_t -y1_t B-D -(D-l)a_t 
_ D D 7 DRS 4 7 D 
E[B(t)] = Be +e L GSE f e 
B-D-j ((D-l)o,t)* 
x Ll + ) =. ae B > D (4.639 
k=1 


Note that if B < D, we obtain: 


When the combat process starts with B(0) = B < D, 


then there are no free bombers. Every bomber will be 


engaged by a defender. 
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Define 


( if the ie defender 1S engaging a bomber 
Y, (t) = 
e otherwise 
inen, Y(t), M— wee baw are Ieal.demescrnoulli random 
a8 fone © B 
feetadles with probability e ae Tneeerore, B(t) = ) Y.(#) 
peaue i=l 7+ 
1s a binomial random variable parameter (B,e H ). Hence, 
Ta At 
Eiemeweys (0) = B,D(0) = Dim@e= Be cee an) (4.69) 


Note: The above result can also easily be found 
if the combat times of individual bombers vs. defenders are 


maeeeerary Dut 1.1.d., denoted 2Z: 


meer B (0) = B,D(0) = DP) = BPiZ > €} 


We summarize the above in the following result. 


RESULT (4.4): 
The expected number of bombers alive at time t 


for the I model is given by: 


22 


=C2 tb “SOS Ube. ; ~(D-l)act 
D D jee eo 7 a 
a “, Dl D-1) ) < 
k 
B-D-j  ((D-1) at) 
ee ee 
k=1 ; 
E (Bie), |B) =b,D(Ojen) = 
“aye 
Be if B<D 


H. THE LARGE-DEVIATIONS APPROAIMATION POR THE 1 MOE 

The large deviations technique is based on the idea of 
displacing the distribution towards a value of interest, 
applying the central limit theorem to the displaced die@are 
bution, and re-displacing. The resulting approximation will 
better estimate the behavior of the distribution at the value 
of interest, particularly when it is in the tail (is of small 
probability). For an exposition and some useful theory, see 
Feller (1971) and Esscher (1932)> tor vaneapplicatienm..— 
Mazumdar and Gaver (1984). 

As noted earlier the combat process is, in the case we 
the I model, a pure-~death process that starts initially from 


state B. The pure death process {B({t); t > 0} operates 


on the state space {0,1,2,...,B(0)}. Let Bey 5 = 0,1,233e 
denote the sojourn times for (B(G)9 ca. 0) eee Xe measures 
the duration that the process spends in state j. Therefiouer 
a j} = 0,1,...,B, are independent random variables with an 


220 


Seeponential distribution F, (-) that has a rate Da. for 


Xx D 
J 
fo) ,D+l,...,B, and a rate Jon meine = 05 lees 25 D— 1, 
The model is constructed to evaluate P{B(t) > z|B(0) = B, 
D(O) = D}. The event {B(t) > z/B(0) = B,D(0) = D} is equiva- 


lent to the event that the process at time t is at state j 


such that j « {zt+l,z+2,...,B}. Let S, be the waiting time 
to get exactly z bombers surviving. Then we have: 
B 
S = io BS Cheez as (4.70) 
Z ee 5 — 
Wessel 
Thus the event {B(t) > z]/B(0) = B,D(0) = D} is equivalent 
to the event {S, > t|B(0) = B,D(0) = D}. It follows that: 
P{B(t) > z B(0) = B,D(0) = D} = P{S, > t|B(0) = B,D(0) = D} 
B 
a eee oye — BO) = D} 
j=Z4t1 


Metre that the case B < DP iS a Special case of a more 
general case where B > D. Therefore, in what is to follow, 
we will assume that B > D. 


Let: 


b, (s) = f e°'F, {at} , (4.71) 


PAPAS | 


assumed to exist for real s > QO, S)< Ss <0. Since the rYamden 
variables Xe for j = D,D+l,...,B are 1.i%d. random variagvec. 
then they have the same moment generating function. Let 


o, (s) be sveh a function. 


Let Fo (s) be the moment generating function of S,- To 
Z in x 
Simplify the notation let F(x) = Fo (x) and F(s) = F. (som 
Z Z 
We will also suppress the initial condition. Then 


Since the random variables AS are independent, we get: 


I oy (s) | (4.72) 


Let V be the probability distribution associated with 


F(-), with mean yp and variance 5 where: 
SX 
viax} SH cs SG (4.730 
F(s) 


Let V(&é) be the moment generating function of V- Teme 


vie) = f e&*yvfax} = ff & 


a0 


Therefore: 


eee Sas) eo, s Sho (4.74) 
F(s) 
Substituting equation (4.72) into equation (4.74), we 
get: 
A 6, (E+s) \ B-D D-1 DE Soa) 
V(é) = (or) I Se 5 ee!) Canes) 
Px j=Hztl ue . 


— 


Let K(&) = &n V(—E) be the corresponding cumulant generating 


meam@etion. Then, 
ieee = (B-D) (2n dy (Ets) - &n d,(s)) 
D-1 
ee OO CES) ene eS) ) (4.76) 
jaztl j j 


Differentiating equation (4.76) with respect to €, and 
evaluating the resulting function at € = 0, we get the 


following expression for the mean u(s). 


(B-D) ¢!(s) p-1 ?x, 's) 
a ee (4.77) 
dy (S) ce : 


Zou 


Differentiating equation (4.76) twice with respect to 
E, and evaluating at € = 0, we get the following expression 
for ther variance: 


" _ ‘ 2 
(B-D) {4,,(s) 9% (5)-(63(s))7} Ded x, GI. (SI- (Oy (s)) 





(3) = ES eee 
(p,.(S)) jJ=2+1 (dy (s)) 
J 
where: 
Do, 
oy (s) = ee s > 0 (4.795 
D 
Joy | 
‘em = jas s > 0, 9 = OF nce (4.605 
Day, 
oy (s) = 5 s > 0 (4.81) 
(Da,-s) 
' . Jo, 
py (She er ae (4.829 
3 (ja.-s) 
2Da, 
dy(s) 7 eo) s > 0 (4.833 
(Da.-s) 
and 
230, 
oy (s) = 7 Ss > OSes... ae (4. 64m 
a (Ja,-s) 


Note that the mean and variance of the associated dis- 


tribution, equations (4.77) and (4.78), respectively, are 


t,o 


mamccteions of s. 


epestributions for F. 


Z 
associated distribution at the point of interest), 


mer Ss. 


an associated distribution V has been determined. 


Therefore, 


(-). Let ul(s) = 


Let s be the value of s such that u(s) = t. 


equation (4.73) becomes: 
SX | 
1 
Vick == ainihe 
Eas) 
with: 
mean = u(s) = t 
and 
warn lancew = ..Omnes) 
Mus 
ee SX 
Flax) = Sbalsje willbe 
and 
oceans 
e 
Substituting, we get: 


Zoo 


(1.e., 


there is a family of associated 


center the 
and solve 
Thus, 


Therefore, 


> 0) (465) 


(4.86) 


~ 


P{s, >t} = F(s) f e “*v{dx] (4.87) 


Invoke a normal approximation to V; this is justified 
if the sum belongs to the domain of attraction of the normal 
distribution according to the central limit theorem. Cer- 
tainly the initial B-D components are i.i.d. and have a 
second moment by assumption, and hence the CLT does apply 
to their sum. Provided Z is not too small (end, (ia 
z= kB(0O), K fixed), then the remaining terms are also 


well behaved, and the normal approximation should be adequate. 


Therefore, it follows that 


ae 
- (x-u (s) ) 
2,~, 
o SX, 200s 


By standard substitution, w = , we obtain: 


2 
~e ~ ~ W 


s a a78(u(s)+wo(s)) 2 a. 
Ja 0 
s?o*(s)-s“o7 (s) 


Multiplying the right-hand side by e to 


complete the square, we get: 


~~ ~su(s)458°0" (s) © -Zlwtso(s))* 
Boas >t} = F(s)e y e dw 


~~ 


Let x = w+ so(s). From the above equation, we obtain: 


fer ey 
~~ ~Syls)+58 0 (Ss) | — 2) 
aioe tieeaeF (sje —..fe dx (4.88) 
Zz —-- 
Y2n so (s) 


Bemmog equations (4.72) and (4.79) to (4.82), we obtain: 














Fae Day i) Das: JOn 
Be) = Da ~-S Cs 
att 3=2+1 6; 
Since u(s) = t, equation (4.88) becomes: 
Do, [Be BY ab al Joy st +550" (5) ee 
PS, >t} = (=: P| ( I =) e (1-6 (so (s))) 
D 4=241 Jp 


(4.89) 


where: 


6(x) is the standard normal probability distribution 
PUMGELON. ale 


- = 10 
2 B-D il 
o(s) = — = 7+ J —= 3 


ae ee a 
(Da.-s) j=24+1 (Joy s) 


and s is the appropriate solution of: 


ae “ i —- ¢ (ae 20) 





2D 


To solve for S, we note that S > 0 since it is the trans- 
form variable for the moment generating function. We also 


note that in order to nee eae) > t} > 0, we must have 

J On ses 

> 0 for every j = ztl1,...,D-l. Hence, s <(2'ie 
JOn-S D 
Therefore we obtain the following condition on s: 





0. << gs: -< (z+l) a, (4.91) 
Define: 


D =2eo JOD 


Hence, if t > t*, then s > 0. We now need to determine if 
for all values of t > t* there will always exist a 0 < § < (z+l)a, 
such that equation (4.90) is true. 


Define: 


D-1 
ECS) = ae + ) — - t 
2D J=Z+1 7 


The function f(s) 1S a piece-wise continuous (differen- 
tiable) function with points of discontinuity —se— See 


J] = zt+l1l,...,D. Differentiating f(s) over the ranges of 


continuity (differentiability), we get: 


—_— ae 
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Dall 


fis) = =P + ) ee LOG MUe- s < (zt+1)o,, 
(Da. .-s) j=zt1 (Ja,-s) 
amd £oOr Joy ae < (nt+l)api De 22 pee): 


From the model assumption we have B > D. Therefore 


Zm(s) > 0 ¥ O<s< (z+l)a,; een = 0S. -< (j+1)a, 


D 
Hence, the function f(s) iS a piecewise continuous func- 
tion, and each piece is a monotonically nondecreasing function 
over its corresponding range. 
Merce that £(0) < 0 for t > t*, and £((zt+l)a)) =o for 
mayeee. Lhus, by imposing the condition t > t*, there will 


~ 


always exist 0 < s < (z+1) a, such that f(s) = 0. The bisec- 
tion method (Gerald, 1984), was implemented to determine s 
numerically. 

Hence, the Large-Deviation approximation for the invul- 
nerable combat model becomes: 

Do) \B-D, D-l ja -st +2570" (s) 
: ( ) ( D 2 
= = II e 

Do.,-s ; 








P{B(t) > z|B(O) = B,D(0) = D} - 
je eeelk J0,,-S 


ores (a) 


where: 
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ct fF =—— + = Be 


rota ae SR ok ) _ 
(Da.-s) j= 2 (Jans) 
and 
Qe eS (z+l)ap 
Such Sthe es: 
D-1 
ee nl ub eee 
Da,-s j=ztl JAp7s 


In Appendix A we derive a general equation for the 
large deviations approximation for a fixed and a randomized 
sum of i.i.d. random variables, together with some applications 


to other logistics problems. 


I. SIMULATION OF BCD MARKOVIAN MODEL 

In order to check the multivariate diffusion apere 
mations for the BCD model, a simulation was Carried ours, 
using Monte-Carlo methods to generate a realization of the 
air-to-air combat process, which is modelled as a trivariate- 
continuous-time discrete-state Markov process. Combat data 


were then generated to compute combat statisties- 
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iiemvenmzte—-carlo Simulation was Constructed based om the 


moMmrow Lng : 
a. The time spent by the process at state (i,j,k) is 
Se ponemelalivye distributed with rate f(1,3,k). If 


desired, the exponential distribution can be replaced 
DyactnmoG bien ecist Gib lon fUnCElon tO Obtain a 
semi-Markov model. 


Let Xi 4,k be the sojourn time for state (i,j,k). 
Then: 


= 
max. - . ee oe g ae (4.92) 


b. The transition probabilities for the embedded Markov 
chain are as follows: 


Present Next Probability 
| ~~ fy (i357) 
ay <) 7 Cir Ly ap F(i,j7k) 
£.(1,3,k) 
TA ST Ss eedblic= Il, f£(i,4,K)_ (4.93) 
Gene ae) 
a Gormma Fea less), 


The conditions in (a) and (b) are used, together with a 
uniform random number generator that produces independent 
samples of a random variable that is uniformly distributed 
ver the interal (0,1), so as to generate a realization of 
the combat process. This is done by generating two independent 


Somoles Of a Unit uniform variate, denoted by U, and U5: 


Zo 


U, is used to produce a realization of the time X. 


iE | 


time spent in state (i,j,k), by applying the inverse trans- 


form method, as follows: 


then 


Therefore, 


Be SES ani = gn Uy 


Thus, we obtain, as is well-kKnown, 


- &n Us 


i340." fa, qa (4° 9e8 


x 


The number U. is used to determine which state the process 


will enter next. After spending Xx 4, units of time in 
f f 


State (1,},k), the process will next transit to: 


as et Oi< U. > f(i,J/K) 
£(i,5/K) £,(i,j,k) + £.(i,5,K) 
Ce jai) otherwise 


240 


We collect statistics for the process by discretizing 
the time domain. Let At be the length of the time increments, 
and T be the length of time for the simulation of the process. 
T could be the time for bombers to be in region from detec- 
tion to hand-over line. Define N to be the number of incre- 


Memes in T. Then: 


wage 


Construct the following: 


BB,BS to be arrays of size (N+1) whose entries are 
ae 
Pay CCB (nt); 06 BS ({n) = y B_ (nat) 
CcC,CS to be arrays of size (N+l) whose entries are 
M 
Celie — ) C (mst); CS(m = ) C (nat) 
m= 
DD,DS to be arrays of size (N+l) whose entries are 
DDin) = )} OD (ndt) De) D* (nAt) 
m / m 


where: 
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(BL (nat) ,c, (ndt) ,D, (nat) ) 


is a (the ae) realization of the state of the process at 


time nA LOreene mee 


replication, and M is the total number 
of replications. 


Let B(t) and s* (B(t)) be the sample average and variance, 


respectively, for B(t). Then: 
M 
sy Gale) 
= m=1 ™ 
B(nAt) = ——— n = O31. aN (4.96) 
and 


M (B_(nAdt)-B(ndt) )* 


s*(B(ndt)) = J +7 Si = 0 1,...N (4.97) 
=1 


It can be shown that the above are unbiased estimators 
for the process mean and variance (Larson, 1983). 
Equations similar to (4.96) and (4.97) can be constructed 


fOr Cit )., sang spies 


J. NUMERICAL ILLUSTRATION FOR VARIOUS COMBAT MODELS 

This section presents some numerical illustrations for 
the various combat models presented above. The illustra- 
tions will be conducted by comparing the diffusion approxima- 


tions with the simulation estimations or the actual parameters 
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when possible. Therefore, for the BCD combat model we 
compare the diffusion approximations to the simulation 
estimations, while for the I combat models we compare the 
diffusion and the large deviations approximations to the 
actual values. 
1. An Illustration for the BCD Combat Model 
The following basic data were used as an example 


moeemode! illustration: 


- A threat of B(0) = 12 bombers attacking an area of 
responsibility of an interceptor squadron that is 
asSigned exactly a = 40 aircraft. Therefore, at the 


time of attack, the interceptor squadron will have 
D(0) aircraft ready to engage in combat where 
WD (0) < a. 

- Each interceptor aircraft (and bomber) is assumed to 
take an exponential amount of time, to kill its 
opponent with mean (ap) 7+ SO0Gi= = =seconds (and 
(ap)~1 = (.004)71 seconds) respectively. 

- The command and control system is assumed to take 
an exponential amount of time, with mean (68)7- = 
(.006)-1 seconds, to detect and engage a fees soomoer - 

FORTRAN programs were written for: 


1. Computing the approximate mean and variance for B(t) 
Mote the dirtfusion approximation. 


2. Simulating the discrete-state Markovian combat process 
BPOTCcomoure the mean, and variance for B(t). The 
number of replications M = 10,000. 


For illustration purposes the following values for 


D(0) were considered: 


DCO) — Gels, oye 0, 20, and 40 


Figure (4.3) shows plots of the simulation mean, 


and the deterministic mean resulting from the diffusion model 
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for the above cases. It is clear from the plot that the 
diffusion approximation produces a good approximation for 
the mean of the process. 

Figure (4.4) shows a comparison of the variance func- 
tion resulting from the diffusion model with the variance 
Pierron resulting from simulating the Markovian combat proc- 
ess, for the above different values of D(0). The figure 
shows that the diffusion approximation provides a good 
approximation to the variance as D(0) increases. Since we 


are assuming an increase of B(0) + D(0) + ~, where B(0) and 








D(O0) + © simultaneously and at a fixed proportion. We 
therefore consider the following 3 cases (k = B(0)/D(0) = 0.6). 
B(0) D (0) 
Case l: Jy 20 
Case 2: Js: 25 
Case 3: 18 30 


Figure (4.5) shows a plot of the resulting vari- 
ance functions of B(t) for the above cases as determined 
by the simulation model and the diffusion approximation. 
The figure shows that the variance approximation result- 
ing from the diffusion model greatly improves as B(0) and 
D(0) + ~ simultaneously and at a fixed proportion. Note 
that the diffusion variance is systematically larger than 
the simulation variance, but the discrepancy is reduced as 


time advances. Since it is probably the relatively long 
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Figure 4.4. Plots of the Variance Approximation Resulting 


from Diffusion Versus Variance from Simulations 
for B(t): BCD Scenario 
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times (of flight of the bombers towards their objective) 
that is of interest, the discrepancy may not be serious, 
but in any case the direction of the difference is conser- 
vative: The diffusion model will predict greater leakage 
of bombers than does the (presumed) more exact simulation. 
The diffusion computation is far more computationally 
economical. Its adoption actually permits many more rapid 
calculations than would use of simulation. 

2. An Illustration for the Invulnerable Combat Model 

The following basic data were used as an example 


for model illustration: 


A threat of B(0) = 20 bombers attacking an area of 
responsibility of an interceptor squadron. 


- The squadron has exactly D(0) = 13 aircraft operational 
and ready to engage. 


- Each interceptor aircraft is assumed to take an 
exponential amount of time to kill a bomber with mean 


== 


(ap) 1 = 20 minutes. 


- An interceptor aircraft is assumed to be invulnerable, 
and is controlled by a perfect command and control 
system. Therefore the time taken for a free defender 
to start engaging a free bomber is instantaneous, i1.e., 
equal to zero. 


- The intelligence has reported that the enemy tactical 
doctrine dictates that the raid to be cancelled if 
there are z = 2 bombers or less alive. Hence, we are 
interested in evaluting P{B(t) > 2!1B(0) = 20,D(0) = 13}. 


FORTRAN programs were written for: 


l. Computing the stochastic mean, stochastic variance 
and probabilities using the Markov-process formulation. 


2. Computing the approximate mean, and variance using 
the diffusion approximation, and then applying the 
central limit theorem to compute the required 
PEOPaSI ity. 
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3. Computing the approximate probability using the large- 
deviations approximations. 


Figure (4.6) shows a plot for the stochastic mean 
compared to the deterministic mean. We find that the 
deterministic mean yields a good approximation for the sto- 
Sastic mean. To further investigate that, a plot of the 
stochastic mean versus the deterministic mean, anda plot 
of the difference between the stochastic mean and the deter- 
ministic mean versus time, are shown in Figure (4.7). It is 
obvious from the figure that the two means form a 45° line 
when plotted against each Other. —Figure (4.7) shows that the 
bias between the 2 means tends to zero as t > ~. The bias 
is defined to be the difference between the stochastic mean 


and the deterministic mean. 


Bias = Stochastic mean ~ Deterministic mean 


Figure (4.7) also shows that the bias is always 
positive and tends to increase from zero at t = 0 toa 
maximum bias of .167, and then starts to decrease to zero as 
££ > oo, This shows that the deterministic mean under- 
estimates the stochastic mean for the initial stages of 
eomoat. 

Figure (4.8) shows a plot for the exact variance 
compared to the variance resulting from the diffusion approxi- 
mation. We find that the variance obtained by diffusion gives 


EmeeCd approximation to the exact variance. Plots of the 
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Peeecmnastic variance versus the diffusion variance, and 

of the difference between both variances versus time, 

ake shown in Figure (4.9). It is obvious from the figure 
that there exists some bias in the variance, and such bias 
tends to disappear as t > ». In this case, the bias is 
defined to be the difference between the stochastic variance 


ememene diffusion variance. 


Bias = Stochastic Variance - Variance by Diffusion 


Since there exists bias in both the mean and 
Variance approximations, we expect to have some difference 
between the actual probabilities for the Markov process 
and the probabilities resulting from applying the normal 
approximation. 

Figure (4.10) shows a comparison between the actual 
mes for P{B(t) > 2/B(0),D(0)} as a result of applying the 
Markov-process model, and the normal approximation values 
weepout Continuity correction using the diffusion approxima- 
tion. Figure (4.11) shows the same comparison as Figure 
See but after applying the continuity correction factor 
@mememe Giffusion approximation. We find that the continuity 
correction factor has improved the diffusion approximation 
results. 

Figure (4.12) shows a comparison between the actual 
values of P{B(t) > 2/B(0),D(0)} and the large deviations 


approximation at large values of t. There is no continuity 
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correction for the large deviations, since the large deviation 
equation has been derived for a sum of exponential random 
variables. Figure (4.13) shows a comparison of the actual 
probability and the diffusion approximation for large values 
of t. Comparing Figures (4.12) and (4.13), we find that, 

for large values of t, the large deviations better approximate 
the actual probability than the diffusion approximation. 
Figure (4.14) shows a plot of the diffusion approximation 
versus the actual probability for large values of t. We 

find that the resulting curve doesn't form a 45° straight 
line. Figure (4.14) also shows a plot of the relative error 


over time, where 


: | Actual - Diffusion| 
relative error = 


Actual 


We find that the error tends to increase steadily until it 
hits a 100% ee a 100% error means that the diffusion 
has resulted in P{B(t) > 2/B(0),D(0)} = 0, while the actual 
probability is not yet equal to zero. 

Figure (4.15) shows a plot of the large deviations 
approximation versus the actual probability. We find that 
the resulting plot forms approximately a 45° straight line, 
which suggests that the large deviations yield a good approxi- 
mation to the actual probability. Figure (4.15) also shows 
a plot of the relative error over time, where the relative 


error, in this case, is defined as: 
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|Actual - Large Deviations 


Relative Error <= Actual 


We find that the error tends to increase initially 
but drops to zero for very large values of t. This suggests 
that the large deviations tend to give a better approximation 
for large values of t (i.e., for values that are in the 


far tail). 
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A. INTRODUCTION 

One of the major problems an air force faces is the 
determination of its budget allocation when a new weapon 
system is to be sia aee in. In this chapter, the term "weapon 
system" means that air force system which consists of the 
following: 

meen rcraft. 

meeomare parts. 

Me Repair facilities, including personnel. 
- Early warning system. 

Other components, such as the intelligence system, and 
the communication, command and control (Cc?) system can be 
considered to be part of the general weapon system defined 
above. For example, as seen in the operational logistics 
models constructed in Chapter II, the effect of the intelli- 
gence system is considered under the total and partial surprise 
scenarios. The c? system effect is introduced very economically 
in the combat models under the BCD scenario, developed in 
Chapter IV, which is represented by the time spent to detect 
and engage an enemy bomber. The early warning system influ- 
ences the duration of the combat. The sooner the attack is 
detected, the sooner the defenders can meet and engage it 


before it reaches the handover or bomb release line. 


ZS 


The outcome of combat depends upon the number of defenders 
ready to engage at the time of attack, D(0Q). For planning 
purposes, D(0) is a random variabe; its distribution has 
been determined in Chapters II and III by use of the logis- 
tics model. 

The effectiveness of a weapon system, WS, must be evalu- 
ated by eden that determines the readiness of WS at the 
time of attack, and then computes the MOE for the squadron. 
Hence, we need a model that is capable of integrating a 
logistics model with a combat model. Such a model is referred 
to as a Combat-Logistics model. 

In formulating combat-logistics models, the type of air- 
craft is assumed to be known to the analyst. In reality the 
analyst may wish to assess the effectiveness of different 
aircraft types. Mathematical optimization techniques may 
finally be applied to the combat-logistics model to define 


the optimal weapon system. 


Be “OBJBETIVES 

The main objective of this chapter is to determine an 
Optimal weapon system for an interceptor squadron that meets 
specified mission needs. The determination takes into account 
budget, combat, and logistics constraints. 

To determine an optimal weapon system,means first to 
identify the various feasible weapon systems that are avail- 
able for the decision maker, considering "real-life" constraints, 


and then to select the weapon system that optimizes the 


264 


fiesure Of effectiveness of the interceptor squadron. in 
reality it may be best to present the decision maker with 
a selection among a few systems (a short menu) along with 


some uncertainty assessments as to cost and performance. 


See oCOPE 

An air-interceptor squadron is selected to represent 
the situation under study. The squadron is considered to 
consist entirely of the same type of interceptor (or fighter) 
meeerart. The decision maker has a budget of $K for procur- 
ing the weapon system, and an annual budget of SKys eer Jere 
allocated for maintenance facilities (repairmen or crews, 
and equipment). 

This study concentrates on finding the optimal way of 
Meseributing (allocating) the initial budget and the annual 
budget among the different components of the weapon system. 
Here the term "optimal" refers generally to the minimization 
of the probability of enemy bomber's penetration. The proba- 
bility of penetration has been analyzed in the previous 


emapeer . 


Pee eHe MODEL’S BASIC CONCEPT 
1. General 
The Cl, model assumes a small or middle-sized air force, 
represented by a squadron, defending a specific area of 
responsibility against a known enemy. However, the mathemati- 
cal modelling is more general and can be applied to many 


meererent situations of varying force size and composition. 


Zo 


2. ~Specirtic Assume tone 
The following specific assumptions can be made: 
(i) The threat can be assessed far into the future. 
The number of enemy bombers attacking, together 


with their capabilities, can be predicted. 


i There is no attrition of aircraft and/or modules 
during non-combat periods. 


(111) No modules leave or enter the logistics system. 

(iv) There is only one level of repair (i.e., no depot 
repair). 

(v) Immediate replacement of flight-line level. 

(an) Full instantantous cannibalization. 

(vil) There is no recruiting or attrition of repairmen 


(or crews) during the non-combat periods. 
(viii) There is no support from any of the neighboring 
country's air force during the combat periods. 
E. APPROACH 
To achieve the above objectives, the combat-logistics 
process of the squadron has to be analyzed. The combat- 
logistics process represents the combat, non-combat activities 
of the squadron. The effect of the budget allocation supplies 
the restrictions for determining the optimal weapon system. 
When a weapon system is procured, it will operate under a 
peacetime environment (non-combat periods), where it should 
be managed and maintained so that it is found in maximum 
readiness when called upon for combat. The weapon system 
then performs itS prime objective (conducts combat), so as 


to achieve certain combat objectives, as measured by a 
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Suitable MOE. Therefore, when comparing weapon systems, we 
need to evaluate the weapon system under both peace and 
wartime (combat and non-combat) environments. 

WS is first evaluated during non-combat periods by the 
Operational logistics models discussed in Chapters II and 
Iii. The readiness (availability) of aircraft is then deter- 
mined aS an initial condition for the warning model. If a 
total surprise scenario is considered then the distribution 
of aircraft readiness, resulting from considering the limiting 
distribution of the operational logistics model, is provided 
as an initial condition for the combat model. If a partial 
Surprise scenario iS considered, then the limiting distribu- 
tion of the operational logistics model is considered to be 
the initial condition for the warning model, constructed 
in Chapter II. The pee model provides the distribution 
of aircraft readiness at time of attack. This is used as 
an input to the combat model, where MOE's are then evaluated. 
A schematic for the above approach is shown in Figure (5.1). 

The combat-logistics process can be formulated as a 
mathematical programming problem. The constraints for the 
mathematical program are divided into two categories. 

l. Budget Constraints 

The budget constraints are subdivided into the 
following two categories: 


(a) Fixed budget constraint: This represents the 
total budget allocated for procuring WS. 


236.4) 
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Figure 5.1. A Schematic for a Combat-Logistics Model 
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(b) Annual budget constraint: This represents the annual 
budget allocated for the squadron to operate and 
Mariteain Wo. 

2. Operational Constraints 
These represent the necessary levels for the various 
Sempenents of WS, so that the squadron can conduct its mission 
during both combat and non-combat periods. Note that the 


budget constraints may be incompatible with the operational 


constraints (requirements). 


F. PROBLEM FORMULATION 
We now consider a simplified illustrative representation 
of the problem confronting a decision maker. Consider an 
aircraft squadron that is assigned a budget of $K to procure 
Meme WS 1S to consist of: 
ime A number, a, of aircraft. 


Dy: M) and M. repairable modules of Type l and Type 2, 
respectively. 


3. R) and Rp repairmen to be assigned to Shop 1 and 
Shop 2, respectively. 


4. An early warning system. 

Suppose the squadron is allocated 2K annually as a 
maintenance budget (or annual salaries for repairmen (plus 
the cost of necessary equipment). 

The squadron is to defend the area against a prototypi- 
cal threat of B(0) enemy bombers, attacking simultaneously 
a number of national and/or military targets. The squadron 


is assigned the responsibility of minimizing the probability 


Zoe 


of the enemy bombers' penetration to or beyond their bomb 
release line (a hand-over line). Recall the following com- 
bat model. Each enemy bomber is assumed, when engaged by 


a defender, to take an exponential amount of time, with 


mean aa to kill a defender (if unopposed). Each defender 
is assumed to take an exponential amount of time, with mean 
Sn ae to detect and engage a free bomber, and an exponential 


amount of time, with mean ait to kill a bomber (if unopposed) 
once engagement starts; the combat is thus modelled as a 
competing risk problem. It is assumed that only one free 
defender can engage a free bomber, and that the engagement 
will be" fighe—-£O-Ene—f immciae 

Let A’ denote the overall Markovian failure rate of an 
individual aircraft, and let Py denote the conditional proba- 
bility that a failure requires just Type l (e.g., engines) 
repair, Po the conditional probability that the failure is 
of Type 2 (e.g., avionics) and Pip the conditional probabil 
that both Type-l and Type-2" failives cecum uns, P} + Py + Pho 
= 1, and the sequence of successive failure types is one of 
independently and identically distributed random variables. 
Finally, it is assumed that repair is Markovian (or exponen- 
tial), where only one repairman can work on a failed module, 
and Wy denotes the rate at which an individual repair of 
Type i, i= 1,2, is completed at Shop 1. Let R, be the 


number of repairmen assigned to Shop i, i= 1,2. 
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Recall that: 


X.(t), 1 = 1,2, denotes the number of modules of Type i, 
1 
1 = 1,2, that are in or require repair at time t. 
B(t) denotes the number of free bombers at time t. 
St ) denotes the number of bombers (hence defenders) in 


engagement at time t. 
Dit) denotes the number of free defenders at time t. 

As shown in previous chapters, the stochastic process 
1X, (t),X,(t); t > 0} is a bivariate birth and death process; 
miemene Stochastic process {B(t),C(t),D(t); t > 0} is a tri- 
Variate pure death process, defined by (2.16) and (4.45), 
respectively. 

It was shown in Chapter IV that the process 
{B(t),C(t),D(t); t > 0} can be approximated by the trivariate 
diffusion process {B(t),C(t),D(t); iS es O}; where B(t), C(t), 


and D(t) is the continuous approximation BOmeEi jis C(t), and 


D(t), respectively. 


ferHODEL'S STRUCTURE 
1. The Objective Function 
Thesebjective of the squadron is to minimize the 
probability of penetration of enemy bombers. The probability 
of more than z free bombers reaching their bomb release line 
momagiven by PiB(t) > z|B(0)}; this can be obtained by blend- 
ing the combat model with the logistics model. From the 


law of total probability, we obtain: 


rag al 


a 
P{B(t) > z|B(O)} = )  PLB(t) 2 270) ss ern 
i580 


It follows that, 


es 
P{B(t) > z\B(O)} = )* BRIBE) > 2 BIO} O00 esa) bee (5.48 
p90 


Let w(B(0) ,Di0) 7c) and 6~(B(0),D(0),+) be the conditional 
mean and variance of the marginal process {B(e)7 = > Oe 
given the initial force levels. From Results (4.2), and 
(4.3), we find that: 


~ 


5 ene (2 COD OD eee 


It follows that P{B(t) > z|B(0) = B} can be conveniently 


calculated as follows: 


a = 
P{B(t) > z|B(0) = B} = ) P{B(t) > z|B(0) = B,D(O) = j}P{D(0) = 3} 
j=0 
= Z- WiB,j,e) 
= an {l - spt) = j} (Siece) 


Thus, 


ie 


: = ZB, 4, ¢) 
F(t) > z|B(0) eee L Seeresene = i} 


where: 





Hence, the objective function can be approximated by, 


a 
min | - ) oS Pipl 0 = 30 | 


Or equivalently by: 


max | y of ESD) piy( @, = | (snc 
WS |4=0 J 
where min| ] refers to the act of minimizing (maximizing) 
WS 
the guantity [ lp Subject to bmdeet constraints. 


To evaluate the objective function, we need, for every 


ie CO 
(a) evaluate the term 0 {2 Using one OF thie 
diffusion combat models constructed in Chapter IV. 
Alternative combat representation can also be 
utilized as required, but the diffusion model renders 
computer calculations economical. 
(es) evaluate the term P{D(0) = j} using one of the 


operational logistics models constructed in Chapters 


7a ee: 


II and Iil for a range of logistics ascetic eare 
parts, repair facilities) that is within budget 
constraints. 


(c) select the optimal combination from the results of 
(Dj 


2. Budget Constraints 
a. Fixed Budget Constraint 
A major constraint when a weapon system is to 

be procured is the amount of available (or planned) budget. 
The budget is thought of, in this study, as a fixed budget 
that is available to purchase the hardware components of the 
weapon system, which are: 

- aircraft, 

=) modules Of Ivee 1,02 = 12 

- early warning system 


where: 


I = number of different types of modules 


Hence, the budget must be equal to or exceed 
the summation of the products of the above components of 
WS times their individual cost coefficients, assuming that 
linear costs are appropriate; otherwise a suitable non- 


linear cost is required. Thus: 
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where: 


K($): Total amount of budget available 
M,  : NUMperrot Medules or Type 1 
a: Ber lyvevaEnang System, type n 
Core. rd: The cost coefficients of aircraft, module 
type 1, andn early warning system 
respectively 
N >: Number of different types of early warning 


systems available to purchase. 
b. Annual Budget Constraint 

The annual budget considered, for this study, 
is the annual maintenance budget. This 1s represented by 
considering the annual running cost of the maintenance 
facilities (e.g., annual salaries of repairmen). 

Therefore, the planned annual budget must be 
equal to or exceed the summation of the products of the 
number of repairmen (or crews) assigned to Shop i times 


their individual annual salary (or cost). Thus we obtain: 


i=] 111 al 
where: 
Ky = Total annual budget planned for maintaining 
WS 
Dee le acreniumoeraiet Repairmens to be.assigned 
- jee) Sey il 


ae 


oe 


r. = The annual salary for an individual repair= 
man assigned to Shop i. 


Operational Constraints 


In order for the interceptor squadron to conduce 


training programs and reconnaissance missions during non- 


combat 


periods, and to be able to cause some damage to enemy 


bombers during combat periods, the number of aircraft, a, 


must have a positive lower bound. The lower bound of a, &_, 


should 
can be 
models 


by the 


a 


be at least 2 aircraft so that some training missions 
conducted. However, the solution strategy for our 
allows different values of Le which can be determined 


decision maker. Therefore, we obtain the following 


Condi €i10nm. 


eee (5 6p) 


Similarly, lower bounds for Mi 1 = 1,2,;...,l ean 


be derived. In order for the event of having all of the 


aircraft assigned to the squadron operational, to occur, 


we must have the following condition: 


(5.99 


= 
|v 
5) 
Ir 
It 
be 
™~ 
NO 
™~ 
bt! 


Since the modules are assumed to be repairable, then 


every shop should be assigned at least one repairman (or 


crew). 


Of course our model implies that the probability of 


having at least one idle repairman at Shop i is one if R; > M,- 


Hence we obtain the obvious constrain: 
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I See Se Si eee Ly ree (By its) ) 


In a more detailed model several crews or individuals might 
work simultaneously. 

Modules that are operational, and not installed 
On any aircraft, are stored in the supply depot. This results 
in a Capacity constraint; for planning purposes, this can 
be represented by the decision maker specifying a certain 
coefficient, Pas for determining the ratio of modules of 


Type i to aircraft, where: 


Ml kee! oo) oS 


Gems2dering (5.7)) it follows thae, 


a) M. i p,a a oS Jl ek (529) 
Tt is assumed that only one early warning system 
is to be purchased for the air defense system. This can 
be represented by the following constraint: 
N 
) i = eee CoG) Fw So deena ye) eae. sy N Goneeus 
Be, OD n 


Finally the WS, WS*, that maximizes the objective 
function and satisfies the constraints is the solution of 
the following non-linear-integer-mathematical-programming 


problem. 


Zia 


es Zz-u (B,7,t) 
max ) of{ AE oy }P{ (DO) = j} 
WS j=0 rie j 
Swie. 
iE N 
cee) au ) dy Ems aK 
i=l jal 
I 
ae a) 
2 
N 
ae = 1 
n= 
a > 
— a 
ops gle eas p.a its. eee 
i. <> Bi ue ee pie — oe Bel 
= Te Wee at 
E. binary = eee 
a, M., R,, i=41,...,1, are positive integers 


In general models that integrate Noqist reas sem 


combat will be referred to as combat-logistics (CL) models. 
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ieee OMbAT LOGISTICS MODELS: SIMPLE ILLUSTRATIONS 
Suppose there are two early warning systems, Ey here! Eos 
aVailable for purchasing. Each system can allow a different 


combat duration. The term "combat duration," referred to 
in this chapter, is the length of time required for the 
bombers to reach their bomb release line, measured from 
the beginning of the engagement. 


Let t, be the combat period achieved by deploying Ey: 


ii 


and t. be the combat period achieved by deploying E 1 


ane 
and t, are assumed to be deterministic. 

Special cases of the above combat-logistics model are 
the Single-Module Combat-Logistics (1MCL) and the Two- 
Module Combat Logistics (2MCL) models. 

1. Single-Module Combat-Logistics Model (1MCL) 


Under the single-module logistics assumptions, 


stated in Chapter II, the corresponding combat model becomes: 


= 7Z-uU(B,7,t) 
MC 1, : max } ME TP DLO ae 
WS 3=0 a 
Ses 
Coa + cM + qj F, + d5E. Los 
Ey + E. = 1 
a > Q 
— a 


ee eee ey 


E E. binary; See positive meegers- 


ar v 
BES) 


Note in the present IMCL formulation we may drop 
the annual budget constraint for the repairmen. This is 
because it 1S assumed that there is only one shop. There- 
fore, the number of repairmen, R, to be assigned to the 


repairshop will be: 


K 
1 
R —— 
ra 
where r = annual salary for an individual repairman, since 


the above salaries are the only component of annual cost 
in the present model. 
The maximization is thus over the specification of 


WS, where we abbreviate the latter as 


WS — [a, M, E,] 


1.e., WS iS represented by a vector whose components are 
the number of aircraft, a, the number of spare modules, M, 
and the particular warning system selected, E;- ee Ey = l 
then the first early warning system is selected, otherwise 
E, = QO which indicates that the second early warning system 
is selected. 

Availability of aircraft is a nondecreasing function 
of the number of modules purchased for a given number of 


aircraft. That is, if the squadron has a number ane 


aircraft then procuring more modules will tend not to decrease 
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eae availability Of aircraft. The above, and constraints 
of 1MCL, justify the following, for a given value of a: 


/K-d)E)-d,E,-c)a 


fee M = minioa, 
c 
1 

IMCL can be solved iteratively over all feasible 


values of a, E and Eo i while choosing M to be as given 


le” 
Eee . 
2. Two-Module Combat-Logistics Model (2MCL) 


Under the two-module lgistics assumptions, stated 


in Chapter II, the corresponding combat model becomes: 


2MCL: max j o{ 2S de) yp (p(0) =e: 
WS j=0 ie 


See 


Coa oe cM, + CoM, + d,E, + d5E. = x 
r, Ry oF r5Ro Ss Ky 
Ey iF E, = | 
ee ee 
— a 
Bl Ss M, = p,a 
als M. < P5a 
Jes Ry S M, 
es R, = M, 
Eye E, IQaligvsaey foie M,, Mo, Ris R, ees eOstulve Integers. 


Zo 


In this case, WS is specified by the vector 


In the k-module, s-shop case the WS is specified by 


an analogous vecter. 
As in the case 

it is assumed that the 

decreasing function of 


Ry, we assume that the 


of the IMCL, for a given a and My 
availability of aircraft is a non- 
M.- Also, for a given a, Mi Mo, and 


availability Of aircraft is a nen 


deCcreacsimag stanetaan son Ro - Therefore for a given value of 
ay M, and Ry: let 
7 | K-d,E,-d,E,-c,a-d My, 
Mes = Min oa } , 
Z 2 CS 
2 
and let 
Ke=r eR 
ea) nh, a | 
2 C5 


2MCL can now be solved iteratively over all feasible 


values of a, My Eye Ea nel Ry while choosing M. and Ro 


2 


as given above. 


ie. SPECIFIC TEBUST RA IONS 
1. General 
This section presents illustrations of some scenarios 
The scenarios 


that can be modelled by IMCL, and 2MCL. 
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considered in this section are the BCD, and the I combat 
models, under the total surprise situation. We first pre- 
sent two illustrations of the IMCL model. one uses the I 
model for the combat part of the model, and the other uses 
the BCD model. Then, we present an illustration of the 2MCL 
model that uses the I combat model. 

The diffusion models constructed in Chapter IV are 
used to approximate the combat process under both the I and 
BCD models. The single-module logistics model, and the 
two-module logistics model, constructed in Chapter II are 
ieeq tO represent the logistics system required for WS. 

2. Model Parameters: IMCL 
The following parameters are used for model 
irustrations: 
ei) Threat. The threat considered is B(®W = 12 
bombers attacking simultaneously. We have not 
taken into account the possible uncertainty in 
‘Lolepmisal ie Valiove/ els" ielauelexsic, qyskeig ane bie ie 
(ii) MOE. The decision maker is interested in mini- 


Mrz ng che prebdabalityveremene than 3 bombers 
Penewicduiny mol emacachinguthelmwbomb>—-release line. 





meme, Logistics. Each alrcraft fails at a rate of 
e= 0, > aAlrcratte per day. 
- There are R = 4 repair crews assigned to the 
Squadron. 
- Each failed module is repaired at rate up = 1.0 


Modules per Wddy,avNere onl mone repair Crew 
Sal work Cl ecdmaihec) mMeOcdU Ler 

- There is enough space to store modules when 
Eneveale Up sane NOEs iMcrolied son dairCracrt ; 


1.e€., 9 is assumed to be o, 
(iv) Combat. Each defender takes an exponential amount 
of time, with rate of ap = 3 (bombers per hour), 


to kill a bomber, where only one defender can 
engage a free bomber. 


7ah3) 8 


- For the I model the defenders are invulnerable, 
siete Ce Sp 0 3 

- For the BCD model, C takes an exponential amount 
of time, with rate 9 = 0.6 to detect and engage 
a free bomber. Each bomber, if engaged, takes 
an exponential amount of time with rate a, = 0.5 
(defenders per hour), to kill a defender. 

- If early warning system E) is deployed enonwaa. 
combat period is €] — 27 0shoum sas bege eee 
Geployed then the combat period 15 t> —= OSc@hewas 

- The lower bound for the number of aircraft, Las 

Sees 
(v) Coste 

- The squadron has been allocated a budgetses 
K = $115 million for purchasing the WS. 

- Bach alreraft costs Coe— >)0 ena ven 

- Each module costs ¢ = (52 million: 

=) The By] costs dj = sai ey while E. costs 
d. a Suse (bik eye 





Using the above parameters, the 1MCL becomes: 


a 
max ) of{ 
WS 4=0 


Zo ee) 


atte 


Soe. 


10a + 2M + 15E, + 5E, < Ils 
Ey +E, = J 
a-M Zee 
Se 


E binary i1=1,2 


a, M integer. 


This model was solved by evaluating all feasible 


284 


Let 


—— t,E, oa t, (1 - E,) 


Then, if Ey is deployed then Ey 1 


otherwise E. is deployed and t = to since E, = 0. For every 


weet 2,),t) and o*(12,4,t) are determined using Result 


——e ana t-— tt 


(4.3) for the I model and Result (4.2) for the BCD model; 
where u( ) and ra ) are the mean function and the variance 
ei@ettOn Of the 1B({t); t > 0} process obtained by the diffu- 
sion approximations. 
3. IMCL Using I Model 

Under the I model assumptions, the diffusion 
approximation for B(t) is given by Result (4.3). 

For every combination of a and M, P{D@) = j} was 
computed using equation (2.8). 

Figure (5.1) shows a surface plot of the objective 
function when E, = 1. The figure indicates that if E, 
is selected as the early warning system to be deployed, 
moem tme Optimal WS = [6, 20, 1], i-e., to buy 6 aircraft, 
and 20 modules, this yields an objective value of 0.9903; 
[m= a probability of penetration = 1 — 0.9903 = 0.0097. 

Figure (5.2) shows a surface plot of the objective 
function when E, —l  whieheendtcates that the Optimal 


solution will be to buy 7 aircraft and 20 modules, and 


obtain an objective value of .9211. 
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Optimal 


s 
Oo 


co + 
oO oO 
aN|DA aAtyalqg 








number of 


at 


level 


Al mG aie 





Bigure o-2 . 


fe@ aie) 


Using SMCL(1) 


Cnt fAice Plotwonethe Objective Function 


Scenario with E, Deployed: 


From the above, it is concluded that the optimal 


weapon system, WS*, is: 


1.e€., buy 6 aircraft, 20 modules, and deploy E,- WS* 
under the single-module logistics and the I-combat assump- 
tions results in a probability of penetration of 0.0097. 
a. Comparison with Exact Computations 
If a = 6 aircraft and M = 20 modules, then we 


get the following readiness distribution, using (4.8): 


; = 0 1 2 3 4 5 6 


O 0.0002 0.0006 0.0017 0.0034 0.0054 0.9887 


P{D(0) = j} 


If we calculate P{B(1l) > 3/B(0) = 12,D(0) = j}, 
}] = 0,l1,..-.,6, using the Markovian combat model, 1,.¢y,se. 
solving the forward Chapman-Kolmogorov equations (4.58) 


numerically, we obtain the following: 


j = 0 il 2 3 4 5 6 
P{B(1) < 3| 
B(O) = 12,D(0) = 37 = O 0.0004 0.1527 0.5444 0.7989 0.9590 0.9892 
Therefore: 
6 
> P{B(1) > 3|B(O) = 12,D(0) = j}P{D(0) = j) = (Ones 
afte 
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It follows that by solving the Chapman-Kolmogorov 
equations numerically for WS* proposed by IMCL, we obtain 
a probability of penetration of 0.0120. This yields a 


metative error of: 


-OO09F.— .0120 

a en ee 
fen, a relative error of about 203 is obtained. This indi- 
Sees that the diffusion is overly optimistic. But, the 


order of magnitude seems adequate, even though the numbers 
eee small . 
4. 1MCL Using BCD Model 
When the BCD combat model was used with the param- 
eters given earlier (1.e., a 


D B 
eave: WS* = [7 15 1J; with an objective value of 0.5288, 


=o ae ee =) O) , IMCL 


1.e., probability of penetration = 0.4712. If early warning 


system E which has shorter detection range than Ey. 


9! 
is procured the corresponding optimal WS = [7 20 OQ], 
with an objective value of 0.4686. This shows that, for 
the current example, procuring E, results ina better 
combat effectiveness than procuring more modules. 
Procurement of WS* = [7 15 1] yields a relatively 
high probability of penetration when compared with the I model 
case. This is due to introducing the combat parameters 
QM, and 6. Table (5.1) shows the probability of penetration 


for decreasing values of a and increasing values of 6. 


BY 


Zoe 


TABLE wo 


BEHAVIOR OF PROBABILITY OF PENETRATION PROVIDED 
BY IMCL AS @ INCREASES, ANE Op, > Q 


Prebalostleiney ae © 


6 Op Penetration 
.6 5 aa 
a6 2 ool 
.6 1 Pcie 
26 05 ToC 
26 005 25 
A ope, 005 BZ 

8 OS 24 
Resto MOOS a2 0 
95 SCOUUS Pals: 

95 0 bs 
.99 0 ales 
2 0 OS 


We find the probability of penetration decreases as On 
decreases and 6 increases. 

It is evident from Table (5.1) that the MOE improves 
as @ increases and/or On decreases. In particular the MOE 
tends to approach the value provided by the 1MCL using the I 
mode IF Uwe. jy ow C eee 

a. Comparison with Simulation Results 

From equation (4.8), we obtain the following 
readiness distribution for a squadron of 7 aircraft that has 


15 modules, and 4 repair crews where the single-module 


logistics are assumed: 


29.0 


; 0 i 2 3 4 5 6 7 
P{D(0) = 37} = 0.0002 0.0014 0.0056 0.0149 0.0298 0.0478 0.0637 0.8366 
Since Ey is deployed the combat duration 
is 1 hour. Therefore the MOE has to be evaluated at t = l. 
sammlating the Markovian combat process {B(t),C(t),D(t); 
Meee} for 10,000 replications; where a, = 0.5 and 6 = 0.6 and 


B 


Smebecting statistics at t = 1, we obtain the following 


Pemeies ror P{B(l) < 3/B(0) = 12,D(0) = j}, 3 = 0,1,...,7: 
- 20 Mie 2 4 5 6 7 
Peet) < 3|B(0) = 12, 
D(O) = 4} ae OO Om Omen Om Ol O 09m) 52 0:0. 59° 0280 


The simulation-of-combat calculation gives 


; 
Wee) <3 |B(0)) = 12,p(0) = 4}eiD(0) =4) =. .72 
j=0 


irene, probabil.ty of penetration = .28. 

Recall that IMCL gave a probability of penetra- 
tion value of 0.47 which yields a relative error of about 
O7o. This indicates (as anticipated in Chapter IV) that 
the diffusion is very conservative, but is of the correct 
order of magnitude. However, the relative error drops as 
B(O) + D(0) > ~. Nevertheless, the use of diffusion provides 
insights, and simple interpretation analysis of the problem 
without an excessive computational burden. Such insights may 


then be used for more detailed investigations if required. 


PAS Mal 


Analysis such as Table (5.1) suggests that sensi- 
tivity analysis can be carried out Gacily onsEhewecomeaus 
logistics model, by changing logistics and/or combat parameters, 
and re-solving the resulting model. The computational bur-. 
dens of re-solving are not at all excessive, in part because 
the calculation of leakage probability is facilitated by 
the diffusion approximations. 

Note that the leakage obtained under optimal 
logistics assignment appear excessive, unless the ce Capan 
bility, measured by 8, can be improved, or perhaps the early 
warning, and hence combat time, be extended. As an example 
of the type of analysis that can be carried out by the use 
of the CL model, a training program is analyzed below. 

Om lis eyaliolnigys 

Suppose the decision maker would like to inves- 
tigate the effect of adopting a certain training program 
for the pilots. Suppose that implementation of the new 
training program results in improvement of pilots’ combat 
and firing skills. Such improvement could be represented 


through an increase in the combat parameter a Suppose that 


D° 
if the new training program is adopted, then the defender 
killing rate increases from an = 3 2 O0sco On = 4.0 bombers per 
Neuire 

Assume that aircraft are required to be operated 


at a higher rate (i.e., no simulators) if the program is 


adopted. The effect of the training program on the logistics 
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EPyoeem Can be represented through the failure rate A. Sup- 
pose that the training program causes the failure rate to 
jiaerease from A = 0.5 to A‘' = 1.0. 

The effect of the new training program on the 
overall squadron performance can be evaluated by the use of 
CL. The new parameters were considered by the IMCL model, 
which gave the following values: WwS* = [7 15 1] with an 
objective value of 0.398, i.e., a- probability of leakage 
ou. 602. 

Comparing the results before and after the 
implementation of the training program, we find that even 
though the training program results in an improvement in 


the skills of the pilots (represented by the higher killing 


rate), it has a considerable effect on the logistics system 
which in turn increased the probability of leakage (.4712 


before implementation versus .602 after implementation). 
5. 2MCL Using I Model 
The following parameters are used as an illustration 
moeethe 2MCL model using the I model. 
ae OSE 


- The squadron has been allocated a budget of K = $75 
Hot lioen £or purchasing WS. 


BeeBach alrcraft costs CS SVAN OY sqak iLL akeyay. 
- Each module of Type 1 costs c, = 5 2 ite Maire sey 
= Each module of Type 2 costs C5 = oll nab ikakretoes 


Mpprcastes OC. =| SlO million, while E. costs a5 = 5 
Mie bon: 
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A repairman for Type l has an annual salary of 
r, = $20 thousand, and a repaliitlan ftOmely een Zs ep ame 
and annual salary of ry = $10 thousand. 


The squadron has an annual budget for salaries of 


ee 


busshogrst ies 


Each aircraft fails at a rate of A = 


per day. 


$80 thousand for repairmen. 


0.5 ale erates 


Condition probability of an aircraft failing duemee 


Type 1 module usw eiteaee ace 


Conditional probability of an aircraft failing duemee 


Type 2 meduber 1s p> — eee 


Conditional probability Of an aincrattetavuliige 


to both types of modules is 


An individual failed module 
has, respectively, a repair 
modules per day, where only 
can work on a failed module 


P, = 2 and P5 = 2 


c. Combat Data 


Each defender kills at a rate of a. = 


HOU. 


If Ej is deployed then the combat period is ty] 
is deployed then the combat period 


while if E 
0.8 nours.< 


hours, 
1s t. = 


The 2MCL, 
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in this case, 


Pip. — Oe. 

Of TVpen ls Sort yee, 

rate yy = 0.5, or > =eeey 
one repairman (or crew) 


at any time. 


. 3.0 bombers per 


Lo 


becomes: 


She ale 


a 
max ) of{ Ss) Pt (0) = j} 


WS j=0 


10a + 2M, + M. + LOE igs: 


ee 
on) 
ea) 
| A 


1 Z 


Zee he 


JA 
CO 


Il Z 


S 2a 


2a 


m9 
| A 
i 
| A 


}A 
= 


el 2 


E, +E, binary 


a, M M R, and R, are positive integers 


et Oe 


2MCL(1) is solved iteratively over all possible 
Pemeemat Satisty the constraints. For every j, u(l2,j,t) 
and o“(12,4,t) are determined using Result (4.3) of Chapter 
Pv where t = t,E, + t,E,. For every WS, P{D(0) = j} is 
computed by solving the forward Chapman-Kolmogorov equation, 
Using proposition (2.1). Table (5.2) shows the different 


WS's when E, is deployed and the corresponding objective 


J 


value. We find that if E, is deployed, then the optimal WS is: 


iL 


WS Sai Oo 2d 
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TABLE Geo 


LLLUSTRATION OF “2ZMGCLV Son 
SCENARIO WITH ELS DECEGVED 
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imo0, Duy 4 aircraft, 8 modules of Type 1, 8 modules of 
Mee, 2, assign 3 repairmen to Shop 1, and 2 repairmen to 
Shop 2, while the last component being 1 indicates the 

and assuming the 2 module 


deployment of E Choosing WS 


ike ie 
logistics system together with the I scenario, results in an 
objective value of 0.7706. 

Table (5.3) shows the different WS's when E. 
1s deployed, and the corresponding objective value. We find 


ici if E, is deployed, then the optimal WS is: 


cee (4 omesS Se 20) 


1.e€., buy 4 aircraft, 8 modules of Type 1, 8 modules of 
Type 2, assign 3 repairmen to Shop 1, and 2 repairmen to 
Shop 2, where the last component being 0 indicates the 


deployment of E,. This yields an objective value of 0.4925. 


Z 
Since WS, results ina higher objective value 
than WS, the optimal solution for 2MCL is: 


Woeme= “(4°08 6 3.2 wll 


Peeemelbeaking probability of 0.2192. I.e., 


ax* = 4 
k= 

MI 8 
k = 

Ms 8 
a 

RT 3 
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TABLE. 5.3 
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Vs 
* — 

Ey = 1 
* = 

Eo = 0 


Solving the forward Chapman=Kolmogorov equations 


for the logistics model, we obtain the following readiness 


epee 1 bution: 
5 = 0 il 2 3 4 
mere — jt = 0.0023 0.0143 0.0435 0.0879 0.8519 
Calculate P{B(1) < 3/B(0) = 12,D(0) = j} for 
ae) 0,!,...,4, using the Markovian combat model, i1.e., by 


solving the resulting forward Chapman-Kolmogorov equations 


Pa 


foo) numerically. This gives 


j = 0 i 2 3 4 


P{B(1) 
0) 


Seon 12> 
ahi =o 0 1.8 ees 0. 54 O79 


Il] Vv 


Therefore, 


meee) > 3/B(0) = 12,D(0) = 7PPID(0O) = gh = 0.73 
jaw 


i.e., a leakage probability of 0.27. 
Hence, the 2MCL solution is a reasonably good 


approximation for the Markovian formulation with 
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relative error = 0.27 eee 2d = AILS 


Oe 


6. Other Cases: Sensitivity Analysis 


Substituting WS* in 2MCL, we obtain: 


l0a*®¥ + 2M* + M*¥ + LOB* + SEX < 75 


1 2 1 2 
2RF + R5 = 8 
My = 2a* 
MS = Zar 


Comparing the above equations for the optimal 


point with the set of constraints for 2MCL, we find that: 


i My and Ms are at their upper bounds. 
2. The annual budget constraint is binding. 
3. The fixed budget constraint is not binding since 


Lae l0a* + 2M + MS + LOE} 94955) — Vic: ce 

= 4, increasing My] and M5 fOr scahy cig amidase 
ee in improvement of the objective value, 
but M,; and Mj have reached their upper) bound pererme. 
the fixed budget constraint becomes binding. 


a. Case l 
Suppose we increase the upper bound for Mo, 


reflected by increasing 05 to 2.5 (1.6237 semange liveemie 


right-hand-side). The solution for the new 2MCL is shown 
in Table (5.4). The new optimal point becomes: 
WS*> = [45°85 9" 3 


TABLE -9 24 


TLUUSTRATION FOR THE EFFECT OF CHANGING THE 
RIGHT-HAND-SIDE OF 2MCL(1) FOR I SCENARIO 
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VALUS 


> 
3 
:< 
Iu 
4D 
= 
AQ 
N 
WW 
oxo 








0-2-0442 
0.0491 
0-2-0490 
0-2-0630 
0.9839 
00-0250 


Weve WON 
NOOO OW OM 


PE ENFUNWUs 
Ue NM MO Ws ed 


© 
Cv 
a | 


3724 


Po pd Pk Pe Pe od Pd pee pee pet pe 
WIALIOWDOOONODDOOOOODOONNNNNVNNN NN UOMO UU 


UNUIE RE EEE PE EEE ERE EWUUWWWWWW WW WNNNNNNANA 
UNV DDOVNAN VO OOUNN ES POTAAIUUE Ee PUNE OPW WN 
WNRIWN RUN RUN ER WN EWN RW NE UN RUN WN ede adele 
NFUINFONEANEOANFEANFOANEANFOANFOANFONFSFUNFSFUNSYN 
me re re ee re ee ee Pe ee et tee PS pet fet ee ee OS pd te me ped ped Oe ped fee Pee Pe Po oe ped bee pee pee pee ped Oe bed pd 
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with an objective value of 0.7808. The budget constraint 
is now binding, and M, 1s at its upper bound while M. BS) 
NOt « 
b. Case 2 
Suppose we are interested in seeing the effect 
of changing the repair rate, 1.e., change H, to 2.0 while 
Po is still 2.5. The solution for the resulting ZiCina 


shown in Table (5.5). The new optimal point is: 


wWS* = [4 8 9 2 4 I] 


with an objective value of 0.8574. Note that increasing the 
repair rate in Shop 1 has resulted in a corresponding 
increase in the objective value, and caused the optimal 
number of repairmen to be assigned to Shop | drops from 73 


to 2, and t© Shop 2 to increase frome ecom. 
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[= LUGLRALTIONerOR LHE EFFECT OF CHANGING 
THE REPAIR RATE AT SHOP 1 OF 2MCL(1) 
FOR I SCENARIO WITH El DEPLOYED 
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VI. SUMMARY AND CONCLUSION 


A. GENERAL REVIEW 

The objective of this research has been to construct and 
utilize analytical models for certain combat-logistics 
Situations. Since combat outcome is often crucially 
influenced by a combatant's readiness, and readiness depends 
strongly upon the adequacy of logistics support, it is 
necessary to link an appropriate logistics model with one 
for combat to create a combat-logistics (CL) model. Use of 
such a combined model allows the effect of the organization 
and budgetary constraints of the logistics system upon 
combat outcome to be directly assessed and optimized. 

The particular situation considered in this dissertation 
has been that of a squadron of aircraft designated to defend 
a small areas against surprise attack by wave of bombers. 
Upon detection of the bombers, ready defenders are vectored 
towards them and engage them in combat. Combat outcome is 
summarized by a measure of bomber leakage through the combat 
zone. 

Both logistics and combat are conducted in environments 
of substantial random variability and the numbers on both 
Sides are small. Consequently stochastic models have been 
developed for the logistics and combat phases of the 


scenario described, and these models have then been linked. 
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The linked CL model allows a decision maker to identify 
fixed resource (budget-constrained) allocations that 
effectively minimize a chosen measure of bomber leakage. 

In order to provide a usable analytical tool, i.e., a CL 
model that can provide practical, reasonable and useful 
numerical outputs with feasible computational resources, 
mathematical approximations have been invoked. Particularly 
is this so in the combat modelling area, where an essen- 
tially transient and multi-state situation must be modelled. 
Various approaches have been taken, but most emphasis has 
been given to a form of diffusion approximation. The 
quality of this approximation improves when opposing forces 
become large, but the approximation provides useful accurate 
inputs to a logistics system optimization stage that would 
otherwise be computationally prohibitive. 

This chapter reviews the models constructed for analyz- 
ing peacetime and wartime activities. It highlights the 
main results obtained, and it points out areas that require 


further research. 


pee PEACETIME (NON-COMBAT) ACTIVITIES 
1. Single-Module Logistics Model 
The peacetime (prior-to-combat) part of the combat- 
logistics process was analyzed with logistics models in 
Chapters II and III. This was accomplished initially by 
representing a weapon system, i.e., a defending aircraft, 


subject to failures as a single module. For this single 
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module situation, a logistics model was developed to 
describe aircraft readiness as a function of the number of 
Spare parts, number of aircraft, number of repair facilities 
and failure and repair rates. The limitation of the model 
is the representation of an entire aircraft as a single 
module. 

2. Two-Module Logistics Model 

To overcome the limitation of the single-module 
formulation a model was developed for the case in which the 
aircraft consists of two modules both of which are required 
for the aircraft to be considered mission capable. The 
model allows for simultaneous failures of the two modules, 
permitting much greater operational realism in representing 
the logistics activities of an aircraft squadron. 

The model is a bivariate-continuous-time Markov 
process. The size of the corresponding infinitesimal 
generator is (M,+1) (Mj+1), which becomes very large for even 
moderate values of M, and M5. In order to solve this 
problem, the matrix geometric approach was implemented. 

With this approach the infinitesimal generator of the 
process was constructed and the limiting distribution and 
the Laplace transforms for general initial conditions were 
determined. 
3. Readiness 
In order to compute the probability distribution for 


the number of aircraft ready to engage in combat, the 
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Surprise phenomenon of war was considered. In this study 
the element of surprise was classified as total or partial 
Surprise. Under the total surprise scenario, the defender 
has no time to prepare for combat, and hence there is no 
opportunity to cause changes to the logistics process. 
Under the scenario of partial surprise, the defender is 
assumed to have an exponential amount of time to prepare for 
combat. The combat preparation phase was modelled by 
decreasing the failure rate of an individual aircraft, and 
increasing the repair rate of an individual repairman. 
Hence, a new logistics process is introduced. This new 
process uses the limiting distribution of the old logistics 
process as an initial condition. The probability 
Gistribution of the number of aircraft ready to engage in 
Beat at time of attack is then computed by saleing a 
linear system of equations for the Laplace transforms. The 
cases studied indicate the degree with which readiness is 
improved when there is a warning time (i.e., partial 
surprise). This evaluation can be used to estimate the 
effect of an improved intelligence system on aircraft 
squadron performance. 
4. Repairman Allocation Model 

The problem of assigning repairmen (or crews) as a 
function of the state of the system was analyzed in Chapter 
III. Optimal assignment was determined by formulating the 


operational logistics system as a multivariate 
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discrete-state continuous-time Markov decision process. The 
optimal policy was then computed by applying dynamic 
programming and linear programming methods to the Markov 
decision process. In order to use Howard's (1976) solution 
algorithms for solving a univariate Markov decision process, 
a general one-to-one transformation function for mapping a 
multivariate state space on to a univariate state space was 
derived. This transformation facilitated solving the 
multivariate process as a univariate process using existing 
algorithms and theory. The results were then retransformed 
to the multivariate case for the final solution. 
5. FurtheneReseareh 

The logistics models presented in this thesis assume 
modules that are operational and not installed on an air- 
craft to be stored at a supply depot ina ready-to—inaeaan 
status. When an aircraft lands with a failed module, 
replacement is carried out instantaneously if there is a 
module of the same type in the supply depot. This assump- 
tion may be relaxed by introducing a random module replace- 
ment time. 

The models studied in this research assume that the 
repair shop is capable of conducting all types of repair. A 
multi-echelon repair system with base and depot repair may 
be considered explicitly by introducing a random delay 
during which time a module is diagnosed as repairable at the 


base with probability 8, or requires depot repair with 
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probability 1-5. See Sherbrooke (1968), Muckstadt (1973), 
Hillestad (1982), and Homesby (1985). 

Other distributions can be assumed for the warning 
time. Gaver (1966) examined a class of densities that is 
convenient for representing warning times and presented a 
method for obtaining an approximate inverse of the Laplace 
transform. This provides some generalization in modelling 
Surprise and the effect of an improved intelligence system. 
This is an area that merits further research. The results 
presented in Chapter II show that the element of surprise 
plays a major role in providing a link between the logistics 
and combat processes through its impact on the initial 
conditions of the combat process. 

The repairmen allocation model assumes neither cost 
nor time involved in assigning/reassigning repairmen to 
shops. The assumption of no elapsed time required to 
reassign repairmen to shops may be relaxed by introducing a 
"state of transition" for repairmen. If a repairman in one 
shop is reassigned to another, then the repairman experi- 
ences a delay (is said to be in limbo) for an exponential 
amount of time. One can also include costs in the repairman 
assignment problem. Two straightforward ways to do this 
are: 

(1) Introduce another objective function. The model 
then has two objective functions. One is to maxi- 
mize the long run expected number of aircraft ready 


to engage. The second is to minimize the long run 
expected cost. The model can then be solved as a 
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multiple-objective Markov decision process; see 
Viswanathan, Aggarwal and Nair (1977). 


(15) Add a new constraint which indicates that the long 
run cost must not exceed a certain bound. The 
resulting model can then be solved for different 
values of the bound. A plot of the objective value 


(i.e., the expected number of aircraft operational) 
versus the long run expected cost can then be 
constructed. 


C. WARTIME (COMBAT) ACTIVITIES 
Analytical models for representing air-to-air combat 
were studied in Chapter IV. The major areas are summarized 


below. 


ler The Finite-Re-Engagement Rate Combat Model (the BCD 
Model) 


The BCD model assumes that defenders are vulnerable 
and spend some time searching for a free enemy bomber. Once 
a free bomber is detected, it is then engaged by a free 
defender until either one of them is killed. If the bomber 
is killed, the defender once again searches for a free 
bomber; if a bomber wins, or 1S never engaged in combat, it 
may leak through the combat zone and attack the area 
defended. 

The combat process under the BCD scenario was 
initially modelled seterminiacieee by a system of differ- 
ential equations. The deterministic model provides repre- 
sentation of the number of free bombers, bombers (hence 
defenders) in combat, and free defenders as a function of 


time. A simple criteria for defenders/bombers to win was 
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obtained in case combat time available is unlimited. An 
equation that predicts (approximately) the expected number 
of defenders/bombers surviving was presented. 

The deterministic model was then generalized bya 
diffusion model. The use of diffusion theory allowed us to 
represent some combat measures of effectiveness in near 
closed form mathematical equations. This, in turn, simpli- 
fied the linking of the combat models to the logistics 
models. 

A trivariate-continuous-time discrete-state Markov 
model (in particular a trivariate pure death process) was 
developed to represent the BCD combat process. A method for 
computing the Laplace transforms of the time-state proba- 
bilities was presented. The Markov process was simulated to 
check the results of the diffusion model. It was found that 
the diffusion results provided good On noraner tons to the 
Markov process. 

The diffusion results were found to produce an 
approximation to the expected number of aircraft alive at 
time t that was identical to that provided by the deter- 
Ministic models. In addition, the diffusion results provide 
an approximation for the variance-covariance matrix. Thus, 
probability statements can be evaluated by using the normal 
approximation. 

The dimension of the system of differential equa- 


tions resulting from the diffusion approximations is not a 
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function of the initial size of the forces. This allows 
military analysts to model economically combat processes for 
larger size problems. It also allows military analysts to 
derive expressions for approximating probability statements 
that represent measure of effectiveness and to compute their 
values without expenditure of excessive computer time. 

2. The Infinite Re-Engagement Rate, I Model 

The I model assumes that defenders are invulnerable, 
and once a bomber is killed a free defender engages a free 
bomber, if any, instantaneously. The combat process was 
modelled deterministically by a differential equation. The 
equation was solved to provide an expression that approxi- 
mates the expected number of bombers alive as a function of 
time. 

The deterministic model was then generalized by 
developing a diffusion model. Expressions that represent 
the mean and variance of the number of bombers alive at time 
t was derived. It was found that the deterministic and the 
diffusion models gave the same representation of the mean. 

A simple univariate pure death model was developed 
to represent the I combat process. It was found that the 
diffusion results provided good approximation to the pure 
death model. An expression for the expected number of 
bombers alive as a function of time was derived. 

To allow more refined approximate calculations to be 


made for the I model, the large deviations method was 
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applied. A large deviations equation was derived to 
approximate the probability of at least z bombers alive at 
time t for relatively large values of t. It was found that 
the large deviations technique resulted in a better 
approximation for the measure of effectiveness than did the 
diffusion approximations. As yet there is no Known way of 
applying large deviations to the BCD model. Hence the 
diffusion approximation has been used in the logistics 
optimization phase of the problem. 

3. Further Research 

The application of the large deviations method to 
multivariate stochastic combat models appears to be a ripe 
area for further research. 

Diffusion models were used to generalize the deter- 
ministic models for air-to-air combat. It would be useful 
to develop similar models to generalize (approximate) the 
deterministic (Markovian) models for other types of combat 
(e.g., land, sea, ground-to-air, etc.). See Appendix B for 
a generalization of Lanchester's linear law; there it is 
shown that the diffusion mathematics recovers Lanchester's 
linear law and provides in addition a representation for the 
variance-covariance matrix of the approximating multivariate 


Gaussian process. 


pee COMBAT—-LOGISTICS MODEL 
Chapter V was devoted to linking the analytical 


logistics models with the diffusion models of combat to 


IES! 


produce a combat-logistics model. The combat-logistics 
model is a non-linear-integer-mathematical programming 
model. That model determines the optimal number of 
aircraft, modules, and the type of early warning system to 
be procured, given fixed budgetary constraints. In 
addition, the optimal number of repairmen to be recruited 
(employed) is determined. The solution minimizes the proba- 
bility of penetration of enemy bombers subject to budget, 
operational, and capacity constraints on the defenders. 

1. Further Research 

Further work remains to be done. The combat- 

logistics model described in this thesis allows a decision 
maker to evaluate the outcome of air-to-air combat, and 
hence provides the initial distribution of the number of 
bombers to be engaged by SAM forces. An analytical model 
for the ground-to-air combat, that can be grafted onto the 
proposed combat-logistics model, is also needed. A 
generalization to the combat-logistics model that allows for 
repeated enemy attacks over a short period of time is also 


needed. 


E. CONCLUSION 

The research presented in this thesis represents an 
effort to develop analytical models which can be used to 
assist decision makers in making some of the complex logis- 


tics decisions having an impact on combat effectiveness. 
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This work represents the first known effort to integrate the 
logistics and combat processes analytically. 
Combat-logistics models of the type illustrated here 
appear to have much to recommend them. Making decisions 
under a peacetime environment that can considerably affect 
combat outcomes is a complex task. The use of combat- 
logistics models similar to those presented here can assist 
the decision maker in answering "what if" questions 
interactively without expenditure of excessive computer 
time. The models can also be used to assist the planner in 
determining the effects of implementing new policies, cuts 
(or increases) in the annual maintenance budget, reductions 
in the number of modules, increases in the number of 
aircraft, improvement of the intelligence system, modifica- 
tion of the early warning system, or improvement in the 


communication, command and control system. 


oa is: 


APPENDIX A 


NUMERICAL STUDIES IN DARCE DEV EATIONS 


A. GENERAL 

This appendix is designed to analyze the large deviations 
technique for evaluating probabilities at large values. The 
analysis includes: Deriving the large deviations equation; 
comparing it with actual values and with central limit theorem 
(CLT) results; and performing error analysis for the entire 
range of the independent variable. 

The idea of the large deviations technigue is to displace 
the distribution of the random variable toward the value of 
interest, which 1S situated in the tail of the distribmesene 
Applying the Normal approximation to the displaced distribu- 
tion gives a new, better approximation to the actual proba- 
bility (Preller wis i); 

The appendix applies the large deviations technique to 
the compound Poisson process and renewal processes. 

An approach to reduce the large deviations error is 
introduced by shifting the value of interest with a prescribed 
interval. This approach is fully illustrated for the com 


pound Poisson process. 


Ee LARGE DEVIATIONS CONCEPT 
Suppose YyprYoree er Y, are independent and identically 


distributed random variables with a Conmon cicerlouelon 


SAILS 


me), such that EY, = = BC. then the normalized 
n 

sum ( ) Y,)/(ovn) has the "n" fold distribution F,. By 
k=1 

the CLT, ne tends to the standard normal (6). 


[NseOeand. Ely 


HOwelarge x, (x) 1s close to unity, which indicates 
that for very large values of x, the CLT becomes empty. To 
Overcome this problem, the large deviations (LD) techniaue 
was suggested by Esscher (1932). Also see Feller (1971); for 
a recent application of the technique see Mazundar and Gaver 
rg 34). 

We now derive the LD equation for P{X > z}, where X is 
either a fixed or a randomized sum of i.i.d. random variables. 

Let FL (x) bewbewpuoOcal iti wciatriDlilon LUunction for X, 
and Fy (s) is the corresponding moment generating function; 


then, 
ean | one FL tduj oa 90 GAS) 


Let V be the probability distribution associated with 


PLCs), with mean uw and variance ae. Then: 
on Eee 
Vidx} = ———— (A=—2) 
F.(s) 


bly, 


Let V(é) be the moment generating function of V. Then: 


Substituting (A-2) and (A-1), we obtain: 


pe Fy (sté) 
V(é) = —— (A-3) 
Fy (s) 


If K(&é) is the cumulant generating function for V, thew 


az) MSA WOE) 
It follows: Erat- 

u(s) = K'(0) 
and 

6 (Ss) = KO) 


Note that uy and of are functions of s, i.e., there is a 


family of associated distributions for PoC). 


Let u(s) = z (i.e., center the associated distribution at 
the point of interest), and solve for s. Let s be the value 
of s such that p(s) = z. Thus, a unique associated distribua 


tion V has been determined, i.e.: 
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e FL {dx} 
WE Lis boc Se — 
F,. (s) 
cen : 
mean = u(s) -= 2Z~, 
and 
2s 
variance = o (s) 
ais , 
ee ere 5X 
FL {dx} = Fy (s) e Vidx} 
ae. , 
2, ore ae “Sx 
eee) Es) J e~" v{dx} 


By the normal approximation: 





By standard substitution, and after completing the square, 


ime get : 


Say 








~ ~~ s6 ~ a 
oo “su (s) +0 (s) l 00 —5(w+so (s)) 
1=F (2) = Ech — foe dus 
Y27 0 
Considering the transformation x = w +s0 (8), we obtain: 
afl. fe came 
A Pe “su (s) +50 CS i oo -x*/2 
1-F, (2) - Fy(s)e So, dx 
¥v27T so(s) 
Hence, the LD equation is: 
oe ae 
a “su (s) +50 (s) >. ae 
1-F, (2) = F(s)e (l-o(so tsa) (A-4) 
where: 
F,(s) = moment generating function of X 
u(s) = Omecmor ay saz 
2,~ 
o (s) = variance of Vv. 


The above equation is the LD equation with parameters 
(Fy (5) ,W(3) po" (3) }. The claim in this appendix is that any 
probability value computed for a@ pointe that as fans aes 
tail using equation (A-4) will result in a better approxima- 
t1on for the actual probable sena emus 

Numerical studies were conducted to compare the CLT to 


the LD approximations. This is dene vaceondimg ses 


- The length of the interval on the real line over 
which better results were achieved. 
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See lne Variation in the relative error over the range of 
the independent variable. 


- The behavior of each approximation at both relatively 
small and large values. 
C. LARGE-DEVIATIONS APPLICATIONS 
1. An Application To Compound Poisson Process 


Let {N(t); t > 0} be a Poisson process with mean it, 


and oe Pleo eee be wae ronivwere 121 .d. random variables 
Papen distribution Bots); where N(t) and Ys are assumed to 
be independent. Define, 
( 0 if N(t) = 0 
DEC) = N(t) 
Ne ie INE) S66 
; i 
i=l 


It follows that X(t) 1S a compound Poisson process, with 


ea) e 


foestr tbution Py (t) 
Suppose we are interested in evaluating P{xX(t) > z} 
where z lies on the extreme right tail of the distribution. 


Let by Cs) be the moment generating function of Yas 


then: 
_ 7 sy 
dy(s) = foe dF, ty} S520 


=— 00 


Let F (s) be the moment generating function of X(t). 


Saal 


N(t) 
Si) Ji 
Fe ce) (o) (= ape en 
= BL(g,(s)) 8 ') 
Hence, 
P ~At [1-9 (s)] 
Py ty 8) = @e ee (0) (A-5) 


To shift the distribution F(-)) te Ener righ 
associate with it the new probability distribution V(:), 
Such: Ehnae 


Sx 
Fy (¢) tax} 


e 
vidax} = ————— s > 0 (A-6) 


Fy (ty (S) 


Let V(&) be the moment generating function for V(-). 
Therefore V(&) 1S given by (A-3); substituting (A-5) we 
obtain: 

Vlei =) ce Pema ia 0) (A777 


The cumulant generating function becomes: 


K(€) = At Coy (st) = by (s)) (A-8) 


BA 


DPierescieticdtrmg (A-ojm with respect to €, and setting 


—€ = 0, we obtain the following expression for the mean of v: 


— t 
CS) eee ee. US) 
Differentiating (A-8) twice with respect to €, and 


setting — = 0, we obtain the following expression for the 


variance of V: 
ecsoa. — At. oy (s) 
betes — S{(Z) 3 2Ze= KE o, (s(Z)), 1.e., let s be the 


value of s that centers the distribution at the point of 


iieerest. It follows that: 

wis} = Atot(s) = 2 (A-9) 
and 

(5) = rton (s) : (A-10) 


From (A-5), we also obtain: 


“w 


“At 1-4, (s)] 
x(t) 


ee. & (A-11) 


Substituting (A-9)-(A-1ll) into (A-4), we obtain: 


S25 


2 


~\t[1-¢, (s) +86" (S) -2-o"(S)] 
P{ xe), 2 ee ¥ ¥ 2°Y 
x [1 - o(sVhEO5 (8)) 1 (A-12) 


2. Example 
Suppose {Y., i= 1,2,...} is a family of indeépender- 
exponentially distributed random variables with mean ia 
Recall that N(t) is a Poisson process with mean it. 
a. Computing Actual Probability 


Let f.. be the density function £or xX(tje 


(ep 
Then: 


where: 


* 
a is the Gamma distribution with parameter (n,u) 
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Hence: 


ar a (6 
Bett) oo n diag j 
) e FLAE) ion = eng ) x > 0 
n=1 4=0 J° 
Db,» Computing Probability Using the» Central Limit 
Theorem 
E[X(t)] = E([N(t)]-Ely] = <* 
Var(X(t)) = E([N(t)]-ElY71 - Nee + =) -_ a5. 
U u u 
Hence 


Z aet / 


Ceignele 
EA ee) > Zh - 1 - 6 —— 
yey 2its) 


c. Computing Probability Using Large Deviations 


The moment generating function for Bee, i 


is given by: 





From (A-9) we get: 


ee are 


lt follows thate 


~~ 


S = Up 27 Oey Zz 


But Ss < u, therefore we obtain: 


~~ 


s = up - V(\tu)/z 


Hence: 
i oe 52 Bs 
~At{1-o.(s)+so! (s)-~o"(s)]} 
aie Cee Meier in aon eee : = wes 
x {l - o(sVXte (S)) } 
where: 


Ss = PW = vixen z 





o,(s) = a 

u-s 

i (e M 
e (ies ie 

Hate _ Zi0 
oy (Ss) = ae 

(u-s) 


Gs Wate 
The following data are used to compare CLT and LD 


to the actual probabilities of the compound Poisson process: 
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- i{N(t); t > 0} is a Poisson process with mean \t, where 
peal 2, So, and 4. 
eee el 29 as a family Of 1.1.d. exponential 


POCO vcd tashecw with rdtevne— 1, 0.5, 0.33, and 0.25. 


- The precision used for calculating the actual proba- 
Prien) Valuer co 0 seein cr 


- The probabilities were evaluated at "z" values ranging 
from 1.0 up tO Zmax, where the actual probabilit 
Se oecing greater than Zpya, 1s less than 0.1 x107°. 


= The error for both CLT and LD is defined as: 


Pe ese ror. = Actual Probability - Estimated Probability 


Actual Probability 


fee RESULTS ANALYSIS 

Figure (A.1) shows the intervals of z over which the CLT, 
or the LD, gives better approximation. The figure shows 16 
cases where z was chosen such that it is greater than the 
mean of the compound Poisson process. The figure shows that 
the LD technigue yields better approximation for larger 
intervals than the CLT approximation. 

Figure (A.2) shows the variation of the error with 
isespect to Zz values for the first fouxy cases, i.e., A = 1.0, 
pepo — 1.0, 0.5, 0.33, and 0.25. The four cases show that 
errors tend to behave in a similar way. It is evident from 
maewttogure that CLT tends to lose accuracy very rapidly for 
Values of z that are not very far from the mean value. On 
the other hand, it seems that the LD approximation is improv- 


ing in accuracy as the value of z increases. The figure 


a2 i 


24 20 
MS et 
25 42 
9 93m ec ee 
4 10 52 
= +630) Me Sey 
5 14 34 


28 26 
i ="45 >. 2 Soe ee ee 
6 10 50 
iW F633 ee Eee 
8 «16 76 
i = 225 ee SS ee eee 
10 20 100 


6 14 b=) 
i eS i ___ ee 
10 20 36 
u = .25 So aa 
14 26 Le 


of ° we 
eI = ao TT) 
3 16 ial 
ib. =) _ EE eee See ee 
le e4 34 
i 251-2975 EES SSS 
16 <3 126 


Zz values 


gm Error C.L.2. < Error Lae 
f—] Weror Debs < {cron Clee 


Note: z-dorain is considerec creater 
than tne mean of the Compound Prcess 


Figure A.1. Error Comparison in S-domain-—) Gomeoumd 
Poisson Process 
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Shows that the worst accuracy the LD gives is at relatively 
small values of 2; the error is relatively small when com- 
pared with the maximum error the CLT generates at relatively 
high values of z, which in all of the cases studied was found 
tO COnverge comhe0 4ecernom. 

Figure (A.3) illustrates the actual probabilities versus 
CLT and LD approximations (in logarithmic scale) for the 
above four cases. The plots show that generally the LD 
results in a good approximation, especially for large z values, 
and it always overestimates the actual probability (at least 
for the cases examined so far). The deviation from the actual 
probability tends to decrease aS z increases. The figure 
indicates that LD error tends to decrease as u increases. 

To get a better understanding on the behavior of both 
approximations, case (4) (i.e., A = 1.0, and w = 0.25) was 
studied. Figure (A.4) illustrates the comparison between 
the actual, CLT, and LD probabilities at small z values. 

The figure indicates that CLT results in a better approxima- 
tion than the Ubeteechnigue. 

Figure (A.5) illustrates the comparison between the 
actual, CLT, and LD at relatively large values o£ Z fou @eae 
4. The plot supports the previous conclusion that LD oiveeme 
good approximation for the actual probability at large vase. 
Ok waza 

1. An Application to a Renewal Process 

Let {N(t), t > 0} be a renewal process. Suppose we 


are interested in evaluating P{N(t) < z} for large values of 
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t. Define X(n) to be the waiting time for the nt? renewal. 
The event {N(t) < z} is equivalent to the event 1xX{(z) >eae 
Hence, we are interested in evaluating P{X(z) > t}. 


Let a be the time between the nth and (n+1)S8t event, 


and er n= 1,2,...} is a family of i.i.d. random variables 
with distribution F({-). Therefore: 
Z 
PIX(Z)) > CYS OP ee eee 
i=l 7+ 


where t lies in the extreme right tail of the distribution. 


Let 
o,(s) = mig fe?” arty} 
Let 
‘ Sma) 
Fy (ny §S) = Efe ] 
It follows that, 
nN Z 
Py (ny $8) (py (s)) See (A-13) 
Define: 
SX 
e F {dx } 
vidx} = a ere) P 
Py (ny $8) 


The moment generating function is given by: 


1, aS a ae 


Substituting (A-13), we obtain: 


Py (Sté) ZZ 


Vee (Ce 
os) 


The cumulant generating function becomes: 


K(é) = zign(>,(sté)) = gn(o,(s))]} 


Differentiaing (A-15) with respect to —, and at — = 0, we 


obtain: 


ZS) 
p(s) = ae ee 


dy (s) 


Differentiating (A-15) twice with respect to &, 


we cet: 
te t 2 
5 Z$.,(S) d,s) = Z(o,(s)) 
O (s) = D) 
(P, (Ss) ) 
Let 
Zo (s) 
— . — NG 
Sees ( be (= by (8) 
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2 


(A-14) 


(A-15) 


= Q, 


(A-16) 


1.e€., S$ is the value of s that centers the associated dis- 


tribMielon abeenie pote te 


From (A-4), the LD equation for the renewal process 


becomes: 


ae -St+58°o° (s) 
PaiGe) 2) = (py (s)) > e 


where: 


{1 -@(so(s))} 


~ zoy (S)bN(S) — 2(gh(8))* 


(gy (8) )* 


and s is given by (A-16). 


f 


The application of the CLT to the renewal process 


is given by the following theorem (Ross, 


Theorem: 


ies) 8) je 


Let u and a assumed finite, represent the mean and 


variance of an interarrival time. Then, 





: yo. 
: jie t/y | ) df ae 


where iN(t), t > 0} is a renewal process. 


as te ce 


tees, INGE eae 


asymptotically normally distributed as t > »o. 
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(A-17) 


EF. TOWARDS A BETTER APPROXIMATION FOR LARGE DEVIATIONS 
Although the LD yields a better approximation to the 
actual probability values, a more detailed research work was 
done towards improving the approximation. This work is based 
On investigating the skewness of the associated distribution 

V. The experiments done for the compound Poisson process indi- 

cates that the skewness value for the associated distribution 
is generally positive, i.e., it is skewed to the right. This 
led to carrying out some numerical studies to determine the 
effect of shifting the mean of the associated distribution an 
amount fA. 


Equation (A-9) becomes: 
z2+A = At oy (Ss) (A-18) 
Beemmog (A-5) and (A-6), we obtain: 


-At[l-o3(s)] » _~ 
P{X(t) > z} = e : eet yvidx 


By the Normal approximation: 


(x-Atp 4 (S))? 
~Atll-g,(s)] 5 : a : 2th, (S) ax 
_— e e 


PIX(t) > z} = e eee 
y2T Zz VAtoe (S) 


Som) 


By standard substitution (considering (A-i3) 9ewe lost amed: 


: ' ee 2 
-At{1-,(s)] , © =s (At! (S) Ho At" (5) > 
ae e 
Jot -/| 


Vt, (S) 


Pixels a —oe 


Completing the squares, we obtain: 


ee, 
~\t (1-0. (S) +80" (S$) 4" (8) J 
P{X(t) > z} = e a Y 2 Y 7 | 
V2 
; a ee 
60 5 (wt SYA" (S)) 
x f e 
= 
Yt" (3) 


Considering the transformation x = wtSVAtoy (S), we obtain: 


ao 
-t 1-4. (S) +8." (S) So" (8) ] 
6d ae ee ¥ vo Yo (Pe - 8 NEE) 


Vth. (S) 


The following algorithm was used for computing A*, where 
the minimum relative error is achieved: 
iy foe eae oe 


2. Set the mean of the associated distribution, u(s) =Z +A, 


3. Compute P{x{(t) > z}, factual and LD) for the competi 
Poisson process. Evaluate the relative error Cys and the 
skewness coefficient Che where: 
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n a |Actual - LD | 


k Actual : 


and 


cee 6|OCLE (2, > er) stop, A* = A 


eq Ay + Increment 


A 
Keak, SGOs ron 3. 
foe Oo LTA-TECHNIOUE: RESULTS ANALYSIS 

Implementing the proposed technigue leads to a better 
approximaticgn to the actual probability values. For example, 
memweas found that for the case of A = 1, and up = 1, the maxi- 
mum relative error for z values greater than the mean of the 
compound Poisson process is .0006. 

The numerical studies done indicate that the large devia- 
@ion using the delta approach gives better approximation over 
the entire range of z-domain, even in the intervals where the 
CLT previously gave better approximations, i.e., for relatively 
eal Z values. 

The numerical studies also indicate that as A increases, 
both the skewness coefficient and the relative error tend to 
decrease for a fixed z value. This continues until A*, where 
the relative error starts to increase, while the skewness 
coefficient continues to decrease. All cases studied indicate 


miiaiteai* is reached before the skewness coefficient reaches 


Se, 


the value of zero. This observation leads to the conciucuen 
that the best associated distribution doesn't necessarily 
have to be symmetric. 
Figure (A.6) shows the values of A* for a given value 
Of z for 16 cases (yp = 1, +5,5% 337) .25, ana 2- 1,2 oe 
The figure points out an interesting feature: The value of 
A* can be chosen to be a fixed value for each uw. These average 


A* values are: 


lisa oe =a the average A* = 2.2 
a i = 2 the average A* = 4.4 
it ae ——e the average A* = 6.6 
If p+ =4 the average A* = 8.8 


Note that average A* = 2.2(u 1 


), and it is independent of 
AX. Applying this criterion for determining A to all of the 
16 cases resulted in a maximum relative error of .08 over the 


ay. 


entire range of z. The proposed approach (1.e., A* = 222 Ge 
in addition to providing better approximations. than the CiT ovem 
the entire domain, gives a simple algorithm to follow. On 
the other hand, if a better approximation is required, then 


some work has to be invested in constructing a table ehas 


indicates the value of A for every z for various rate values. 
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APPENDIX B 


LANCHESTER'S LINEAR LAW: A GENERALIZATION 


A. GENERAL 

This appendix is designed to generalize Lanchester's. 
linear law (LLL). Let B(t) and D(t) be the surviving com- 
batants at time t in the attacker and defender forces, 
respectively. Assume B(0) = B, and D(0) = D. 


Let a (a._) be the rate at which an individual defender 


D B 
(attacker) kills an individual attacker (defender). 
Define the following functions: 
b(t), an approximate representation of the number of 
attackers alive at time t, given the number of 
attackers and defenders entering combat initially. 
d(t), an approximate representation of the number of 
defenders alive at time t, given the number of 
attackers and defenders entering combat initially. 
Be DETERMINISTIC MODEL: SILER MOET 
Assume that the attrition rates are proportional to the 
number of targets as well as the number of firers. The 
combat process can be modelled deterministically (LLL; see 


Taylor (1983)) by the following system of differential 


equations: 








weit) = - a, b(t) d(t) 

(B.1) 
dd(t) _ _ 
at = Op, Ce ec ey 
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meen initial conditions: 
b0) = ~Bi0) 
a0) = (0) 


The first equation of (B.1) represents the rate of change 
of b(t) as a function of time. The expression states that 
the rate of change of the attackers depends on the number 
Of attackers and defenders alive at time t. The expected 
decrease in b(t) caused by a defender killing an attacker is 
represented by the term a,b (t)d(t) . A similar argument is used 
to write the second expression of (B.1). 

Before presenting the solution for (B.1), we carry out 
a similar analysis as for the BCD scenario presented in Chap- 


mem iV. From (B.1), we get: 








im@eectating both sides of (B.2), we obtain: 
a, [b (t) - D(G apy Ld (t) amc (0) | 
meome tie initial conditions, we get: 
a, (b(t) - B(0)] = apfa(t) - D(O)] vt (B.3) 
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Criteria for Defenders to Win 
A rough criterion for defenders to win can now be obtained 


by assuming that in order to conclude that defenders won, 


we must have b(~) = 0 and d(~) > 0. Under this assumption, 
and as t > ~, (B.3) becomes: 

OL yd (~) = ApyD (0) = a,B(0) (B.4) 
Slnee Apr Ap, and d(~) are all positive values, then: 


Therefore, the condition for the defenders to win is to 


satisfy the following condition: 


Notice that equation (B.5) is the same as equation ((4.9) 


\ 
\ 


which gives the condition for the defenders to win in air- 
to-air combat under the BCD scenario. So the deterministic 
model for the LLL model, which is usually used to represent 
land combat, and the BCD model resulted in the same condition 
for the defenders to win (eventually). This is due to the 
fact that the condition given by equation (4.9) (hence, ((eaaa® 
1s independent of the engagement rate @, and also because of 
the fact that the product, b(t)d(t) ,2inw4. anda ee) eee 


be replaced by any function with the same result. 
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ive wecOlUErOn fer equation (B.1) is given by Taylor (1983): 


a,B -a,D 
B | -—— ——_———_—_, ] for D B 
| 0.,,B ~ aD exp [- (o.,,B ~ opD) t] 5 7 ae 
b(t) = (B.6) 
a f D=aB 
1 +0,,Bt Dow 5 
and 
Q=) =o. 5 
bm sage. 
0) | for 6D 7 OLB 
( 2D aa) aaa) Cee D B 
d(t) = 
| ae f De ee 
I +o,Dt cp 2B 


These equations permit easy numerical computation of b(t), 
and d(t), 1i.e., the representations for the number of combatants 
of both forces at various points in time during the combat 


period. 


eee DLFrPUSLON MODEL FOR THE LLL SCENARIO 

Following the arguments used in Chapter IV to derive 
the diffusion approximation for the BCD scenario, we can 
formulate the combat process under the LLL scenario as a 
diffusion process. 

Define the following: 


B(t) to be a stochastic diffusion representation for 
the number of attackers alive at time t. 
Zhi towbe a dittusion representation for the number 
of defenders alive at time t. 
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N to be the total number of combatants Of=betn toneces 


available for combat initially (1-.e., N = Bo) + pie 


We can characterize the land combat process approximately 
when N+ » (hence, B(0) + D(0) > ~), by treating {B(t) ,D(t); 


t > O} as a bivariate diffusion process. We can model the 


state vector 1B(t),D(t); t > 0} by weiting te goeegemnomn 


of Ito stochastic differential equations as follows: 


dB(t) = -apB(t)D(t)dt - Vo.,B (t) D(t) aw (t) 
(Bae 
GD{t) = OBE) DCE) ies yore tye iey eli 
where {W(t); t > 0} is a standard Wiener process. 
Consider the following transformation: 
B(t) = Nb(t) + YN X, (t) 
(B.8) 
D(t) = Na(t) + YN X, (t) 
Differentiating (B.8), we obtain: 
dB(t) = N db(t) + YN AX, (t) 
(Bes 
dD(t) = N dd (t) + (y/Nigae eae) 


~ 


where: b(t) and d(t) are deterministie tuncriess oneeunor 


being approximations to the process means {X,(t); t > Ou 
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|= 1,2, are stochastic elements, all of which need to be 








determined. 
Suppose that X, (0) = X, (0) = Q. Then we obtain, 
(2 ee (B.10) 
N 
and 
: ae HCO) 
d(0) = r 
Let a, = OLN and an = aN EOuMerecOnstanmas as N > oF 1,65, 
assume that Op and Ob to be small enough such that aN and 


aN > constant as N > », This means that on the average a 
defender or an attacker takes a relatively long time to 
achieve a kill. 

ereoloselitting (8.6) sand 4b. 9)  ameo )(b. 7), and 1solat— 
ing terms of order N and YN, and letting N > ~, we obtain 
the following sets of equations. 


1. Deterministic Equations 


The terms of order N yield: 








db (t) oe apb (t)d (t) 
(Bada) 
dee) tes ae 
at = a,b (t)d(t) 


Pei initial Conditions given by (B.10). 
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Equations (B.1l1) are equivalent to equation (B.1), 
which shows that the diffusion approximation for the LLL 
scenario results in the same approximations for the process 
means as the deterministic model. 
2. | Stochasttesbquattvenus 


The terms of order /N yield: 


~~ 0lUNe 


AX, (t) = {apa (t) X(t) + dpb (t) X, (t) dt - Vonb (t) d (t) AW (t) 
(B.12) 
AX, (t) = Lad (t) X; (t) + ab (t) X, (t) dt + ¥a.,b (t)d (t) AW (t) ° 


Writing the above in a matrix form, wemger: 


aX(t) = A(t)X(t)at + V(t)aw(t) 
where: 
X, (t) 
X(t) = 
X(t) 
and 
“Va, b(t) d(t) 
Vit) = 
VE_b (td (t) 


348 





and 


rand (t) — -apb(t) 
A(t) = 
-apd(t)  -a,b(t) 
Since X(0) = on b (0) and d(0) are given by (B.10). 


igen by appealing to the central limit theorem, for all t > 0, 
{X, (t) ,X, (t) i Cebit wan ony cigtctbe noma aistri bution 
with mean 0 and covariance matrix > (t) which satisfies the 


Following differential equation (Arnold, 1974): 


a= Ae Ce) eas (heey ey (ED (e113) 


Recall that 


B (t) b(t) eae) 
= N + YN 
D(t) d(t) ete) 
t L 


Therefore, we have obtained the following: 


Ee@oubir (B.1): 
Pitt) pets appVtoximactely bivariate normal 
(Gaussian), as N + » (hence, B(0) and D(0) - © simultaneously 


eae a fixed proportion). 
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[B(t),D(t)} ~ Normal (pce) cice neue 


By the required substitution and multiplication, we 


ei 


ab (t)d (t) -b (t)d (t) VE,0, 


V(t)v (t) = 


“b(t)d(t)V%55 a gb (t)d (t) 


Wicdse atic 


Bquation (B.13)° becomes: 


Witch.  itedal) Once Tens: 


where: 
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~2ap,d(t) —2a,b (t) 0 


~ ne ~e ~ ~e ~ ~ 


oar) = “Op, (t) - (a,b (t)+a,d (t) —anb (t) 
0 aoa cae) east (C) 
and 
a pb (t) a (t) 
BuGe) = See ees 
a,b (Enid Ce) 


D> LLL MARKOVIAN COMBAT MODEL 
Suppose an attacker takes an exponential amount of time 


with mean cae to kill a defender; and that a defender takes 


D Por Kile ath attacker . 


an exponential amount of time with mean oa 
Then the combat process can be represented by the bivariate- 
continuous-time discrete-state Markov process {B(t),D(t); 


MeO; Operating on the state space S = {(i,j): 0 < itj; 


pv 


memo, ...,B;> 3} = 0,1,...,D!}. 


The transition probabilities of the process {B(t),D(t); 


ct 
V 


> 0} of order dt are as follows: 








ie IEA IE Probability 
ei) ) 3 be gpl), f£.(i,j)dt emo Git ) 
= (GaSe a) £,(1,j)dt SF ey ahs, (B.14) 
> Cis) i> £{a jdt + o(dt) 


oy 


where: 


f.(i,j) = a,j 
fou) = ean 
£(1,)) = Gs eee 
bec 
mn,ij(t) = P{B(t) = i,D(t) = j3/B(0) = m,D(0) = n} 


For simplicity of notation we will suppress the initial 


CONGItE1ON wana write; 


Ae) = amano 
Apparently {B(t),D(t); t > 0} as defined by (Bia ieee 
a finite state bivariate death process. 


The forward Chapman-Kolmogorov equations are: 


PR ptt) = ~£(B,/D)P, 1 (t) 
Ph git) = -£(B/J)Py a(t) + £,(b,j+1)P, g(t) <j <D 
Pi pit) = £0. -D)P, 5 (2) a By Peon oleae (B.15) 
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ae) 


ig 
S 
I! 


4 Eley Wea els, + ee) eee 
+ Eel Many at eee 
I SS Ba 
(4c) 
(Come “d) 
PO a = Ea) Ey 4) Lesvaiec D 
' ° 
Ps tt) = £3 (1,1)P, 4 (t) Jo tS B68 
Peeem initial condition 
( eed) ee) 
jae 
0 otherwise 
Let P, ,‘s) be the Laplace transform for P. ;{t). Then: 
a 7 st 
oa 4! C P, 4 (t)dt a = 0 


We now take the Laplace transforms for (B.15) by follow- 
ing the procedure done for the BCD scenario; and using the 


femetal Condition we get: 


SR ye. 


‘ - 1 

[2D = SES 

a 7 1 | | 

ie) a FB jy rs fp BSH B, 341 (5) 1 Senge 

Pi) = Feil PPyy pis) bis Ba 

i) = FUayret tpt jH1)P, 541 (8) pe (i+1 DP. 48 s) } (B.16) . 
1<j< Bl 
ee haat 

p AS) y= 1 ¢ (1,4)P . (Ss) i Jeo! 

Ss Ss D : ltd —_ J = 

Py (se) =) Sec) pane (5) 14428 

0 oS Rea nee | zs Ro 


Figure (B.1) shows a graph representation for the Markovian 
combat process. Equations (B.16) are ina form that is 


Suitable Eoerta recursive —setuetone 


(s) 


P (s) is given in (B.16). Now we can find P, D-1 


and P (s) since they are functions of P (s) only. The 


B=, 


B,D-1'S? and P 


find Pp 


B,D 


as 


P B-1 p's) are the only transforms needed to 


w~ 


(s), P (s), and P (s), as given by (B.16). 


Bae Binal be IE Ba=Z7e 


Continuing this way, we find, as in the BCD Markovian model, 


that by knowing the Laplace transforms of the states in the 


ele 


n depth of the graph, the Laplace transforms for the (n+1) em 
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oe depen i 


ee D) £ (B,D) 


« depth 2 


« depth 3 





Pogure B-l. A Graph Representation of the LLL 
Combat Process 


55> 


depth can be’calculated for any value of So) thereren ea 
algorithm similar to the algorithm used to solve (4.49) can 
now be constructed” €o ‘solves cm oi: 
1. Construct the graph of the process as follows: 
For the nt) depth, £ind thempocsible stareouana 
calculate its width, i.e., how many states are in 
the n& depth. Continue until the width of the 


depth wsezerer 


2. For the nth depth, af the width = 0, step. Else, 
pick a state (say (i,j)). Then: 


a. Calculate the mean of the corresponding sojourn 
time of the state (mene. (Nein ama 


b. Examine all states in the Gye) OS depth to deter- 
mine states that are accessible to state (1,)j). 


c. Calculate the corresponding transition rates from 
the states determined in b. t0 state (i,j). 


d. Calculate the Laplace transform for (1,3). Rega 
for all states in the nth depth. 


The solutions for (B.16), i.e., the Laplace transforms, 
can be used to evaluate quantities of interest, such as: 


m.(i) = P{i defenders eventually survive combat} 


Following the same arguments presented for the BCD model, 


it can be shown that: 
t.(1i) = £,f1,5)P, 5 10) (Bel 


and 


aU) (B. Bey 
J 


E. SIMULATION OF LLL MARKOVIAN SCENARIO 

Following the same arguments used for simulating the 
BCD scenario, we can simulate the LLL Markovian combat 
process. 

The Monte-Carlo simulation was constructed based on the 
following: 


a. The time spent by the process at state (i,j) is 
exponentially distributed with rate f(i,j). 


b. The transition probabilities for the embedded 
Markov chain, are as follows: 


Present Next Probability 
i. £ (1,9) 
ia; )) <a Cale jell) F(i,j}) 
Ach (B.19) 
: mel eae 
i (ae) 
Generate UL and U. as ne ene CCD simulation. A realiza- 


mon of xX. 46 time spent in state (1,3) can be obtained by: 


I 


= iol Us 
° . = in ee B20 
ay 16 (a) ( 


After spending X. ; UNntts Of time wn state (1,)), the 


7 


meecess will transit to: 


(i, 3-1) if ONL 
(B.21) 


(a=-1,7) otherwise 


So / 


Let {B (ndt) ,D, (ndt) ; M = 152, 205,M!i be aieie a) 


realization of the process {B(t),D(t)} at time nAt, and 
during the mth replication of the simulation model. 

Defining BB, BS, DD, and DS as in vehe BCD simuletrene 
we can calculate the statistics by applying equations 
(4.85) and (4.86). 

The following basic data were used as an example for 
model illustration. 

A threat of B(0) = 12 attackers engaging exactly D(0) 
defenders. Each defender and attacker is assumed to take 


an exponential amount of time with mean (a ‘aie = (06) ae 


D 
1 = 


minutes, and (a,) ~ = (.004) minutes respectively, to kill 


B 
an Oppenenc. 
Suppose we are interested in evaluating P{B(t) > 3] 
B(O) = 12,D(0) = 4} for 4 = 1,2,..5, 202) HORSeAlle pre creer 
were written for: 
1. Computing the stochastic mean, variance and proba- 


bility distribution fOr B(t) usSimeethe iouwaiad 
Chapman-Kolmogorov equations. 


2. Computing the approximate mean and variance using 
the diffusion approximation to compute the requires 
probability. 

3. Simulating the Markov process to compute the stochas- 


tic mean, variance, and required probabilities. 
For illustration purposes the following values for D(0) 


were considered: 


D(0)> = 3,65, 0) 22 teeanee aw 
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a a ae 


Figure (B.2) shows a plot of the stochastic mean result- 
ing from the simulation model and the deterministic mean 
meeulting from the diffusion model. It is clear from the 
plot that there exists a bias between the stochastic mean 
and the deterministic mean. The bias > 0 as D({(0) increases. 
It is also clear that the deterministic mean underestimates 
the stochastic mean. 

Pigusemih.5) shows a plot for the variance function result- 
ing from simulation compared to the variance function result- 
ing from diffusion approximation, for the various values of 
D(O). We find that the variance of the diffusion tends to 
approach that provided by simulation as D(0) increases. 
Figures (B.2) and (B.3) show that the diffusion approximation 
model results in good approximation as D(0) increases. The 
example shows that for a relatively small value of D(0), 
eee, D(0) = 16 and D(0O) = 20, the diffusion approximation 
started to result in a good approximation. 

Since there exists bias in both of the mean and variance 
approximations, we therefore expect to have some difference 
between the actual probabilities for the Markov process and 
the probabilities resulting from applying the normal approxi- 
fevione To compare the ditferent values for P{B(t) > 3| 
B{(0),D(0)} a value of t = 20 minues was selected. 

Figure (B.4) shows a comparison of the actual values for 
P{B(t) > 3|B(0),D(0)}, as a result of solving the forward 
Chapman-Kolmogorov equations numerically, to the normal 


approximation values with continuity correction using the 
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Figure B.2. Deterministic Mean Versus the 
stochastic Mean of B(t): LLL Model 
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fae tiston atproximation, and the probability resulting from 
the simulation model. We find that the simulation output 
represents the actual probability obtained by solving the 
Chapman-Kolmogorov equations. The diffusion tends to give 
a better approximation as D(0) > ©. 


Figure (4.5) shows plots for the various differences 


between the probabilities which supports the above observation. 
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